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ABSTRACT 

This report describes the comprehensive evaluation 
study of the California State Preschool Program which involved 
elementary school children in educationally disadvantaged areas 
thrdughout California. Various test scores of approximately 6000 
children in kindergarten, first, and second grade who had previously 
participated for at least a year in the State Preschool Program were 
compared to the scores of two other groups of children, those who 
were net graduates of any identifiable preschool program and those 
who had attended a Children's Center Program. Evaluation was based on 
student: scores on the Entry Level Test, Cooperative Primary Test, 
Attitude to School Questionnaire, Student Productivity Index, and 
attendance records. Comparisons were made between the performance, 
motivation, and productivity test scores of students. A detailed 
discussion of the results is included in the report. (CS) 
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SUMMARY 



Evaluation Study of the California State Preschool Program 

This conprehensi ve study of the California State Preschool Program has reached 
mixed conclusions about the success of the program in meeting its goal of improving 
the performance, motivation, and productivity in school of educationally dis- 
advantaged children^ 

The study involved 35,286 children at 148 selected elementary schools in 
educationally disadvantaged areas throughout the state. It was conducted for the 
office of the state's Legislative Analyst, by the Center for the Stu4y of 
Evaluation (CSE) at UCLAo 

The Legislature voted in 1973 (AB 451) to require a study of the Preschool 
Program. The study was intended to assist the legislators in determining whether 
or in what form to provide for future funding of the program, whose federal 
support runs out June 30, 1975, 

In the report of their study, CSE concluded that the Preschool Program 
"probably" was successful in spurring performance and motivation of students. 
However, no evidence was found to justify a statement that the program "definitely" 
fostered improved performance and motivation. Moreover, CSE concluded that the 
Preschool Program probably did not improve the productivity of its graduates. 

In addition, CSE found no significant difference between the performance, 
motivation, or productivity of students who had been enrolled in the Preschool 
Program and that of students who had been enrolled in the less costly California 
Children's Center program. 

For their study, the CSE researchers selected children currently in kinder- 
garten, first grade, or second grade who previously had participated for af least 
a year in the State Preschool Program. They then compared scores that these 
children registered on various tests with scores of two groups of other children; 
cliose who were not graduates of any identifiable Preschool Program and those who 
had attended a Children's Center program. 

In no case did the graduates of the Preschool Program score significantly 
better on tests of performance, motivation, or productivity in kindergarten, 
first grade, or second grade than the children who had not been enrolled in a 
Preschool Program. /However, on most of the tests of performance and all of the 
tests of motivation, the scores registered by the graduates of the Preschool Program 
also were not significantly lower than those registered by the children not ex- 
posed to the program. That is, on these tests there was no statistically signif- 
icant difference between the average scores of the Preschool graduates and those 
of the children who had received no Preschool trair^ng. 

The CSE researchers judged this finding to indicate that exposure to the 
Preschool Program probably — but not definitely — was associated with some 
improvement in student performance and motivation. 

The researchers acknowledged that the decision to evaluate in this Wc^y the 
lack of significant difference between the test scores of the two groups could be 
viewed as generous to the Preschool Program. But they noted that there was 
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reason to believe that the backgrounds of the students who were enrolled in the 
Preschool Program might have been even more educationally disadvantaged than 
those of their current elementary school classmates. If that were true, then 
the Preschool Program could be judged at least a partial success if it raised the 
performance and motivation levels of its graduates up to the levels of their 
present school classmates. 

Therefore, the CSE researchers decided to give the Preschool Program the 
benefit of the doubt and rate it a "probable" success if the test scores of its 
graduates were not significantly different from the scores of their elementary 
school classmates. The researchers would have rated the program a "definite" 
success if the test scores of its graduates were 'significantly superior, on 
aver,^ge, to those of their present classmates. 

These problems could have been avoided, the CSE researchers said, had they 
been able to use an "experimental" research design. This would have involved 
randomly assigning some children to the Preschool Program, some to the Children's 
Centers, and some to No-Program, and then following their progress through the 
first three years of elementary school. Such an evaluation study would have per- 
mitted the researchers to be completely confident that their findings were due 
solely to the influences of the various Preschool experiences, rather than to 
differences in the initial educational capacity of the children. However, that 
sort of study would have required more than three years to complete, and the 
Legislature wanted the results within one year. Moreover, the Legislature 
specifically called for an "after-the-fact" research design which would serve as 
a substitute for a three-year "experimental" research design. 

The CSE evaluators began their study by selecting a representative state- 
wide sample of agencies operating State Preschool Programs. They chose 42 such 
agencies, in cities ranging from Redding in the north to San Diego and Calexico 
in the south. Heavily represented, of course, were the Los Angeles and San 
Francisco areas, the state's leading population centers. The researchers then 
identified 148 elementary schools attended by graduates of the 42 Preschool 
agencies. 

Data were collected for 35,286 children attending kindergarten, first grade, 
and second grade at the selected schools- The researchers then went through 
rosters of each classroom, selecting all the Preschool graduates on whom Ciiere 
was evaluation information and picking an equal or smaller number o' children 
who had received no Preschool training. These final samples contained 1,180 
kindergarteners who had been enrolled in the Preschool Program and 1,148 who had 
not; 977 first graders who were graduates of the Preschool Program and 974 who 
were not; and 714 second graders who had attended the Program vs. 712 who had 
not. In addition, three more samples were selected of children who had been en- 
rolled in a Children's Center program; 146 kindergarteners, 94 first graders, 
and 66 second graders. 

In seeking measures of the performance, motivation, and productivity of 
these children, the researchers took great care to disrupt as little as possible 
the everyday activities of their schools. The researchers found they could ob- 
tain meaningful and comprehensive data without having to administer a battery of 
special tests to the children. In fact, they administered only one such test. 
The other data were assembled from scores on tests already administered to all 
children in California public schools and from special rating sheets completed 
by the children's current teachers- 
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The CSE analysts noted that it might have been useful to examine other as- 
pects of the impact of the Preschool Program, such as its effect on medical or 
nutritional supervision of children. But the law mandating the evaluation study 
directed the researchers to concentrate their analysis on performance, motivation, 
and productivity. 

To measure PERFORMANCE the researchers used scores on two tests administered 
statewide. For children in the first grade at the time of the evaluation they 
used the Entry Level Test , developed by the California State Department of Edu- 
cation to measure immediate recall, letter recognition, auditory discrimination, 
visual discrimination, and language development of children. For children in the 
second grade the researchers used the Cooperative Primary Test - Reading, which 
had been administered to the students in the Spring of their first grade year. 
To perform on this test students must read words, sentences, and paraqraohs. 

The researchers used two measures of MOTIVATION: the Attitude to School 
Questionnaire (a test devised at CSE in 1970) and children's attendance records , 
as maintained by their classroom teachers. Scores on the Questionnaire, v/hich 
was administered to children by their teachers, were collected for students in 
all three grades, as were attendance records. 

The Questionnaire recorded student responses to pictures and oral descrip- 
tions of various school-related activities. The children responded bv circling 
a drawing of a happy, neutral, or sad face. 

Although absenteeism has not been widely used in large-scale evaluation 
studies as a reflection of stjdent interest in school, the CSE analysts said 
they found support for employing it as such in their review of research on 
assessing young children. 

The researchers decided to define student PRODUCTIVITY not in terms of out- 
put of educationally useful products, such as completed homework assignments or 
projects, or even pt^ms and scientific experiments, but rather in terms of the 
students' devotion to accomplishing tasks. To test this quality the analysts 
used a Student Proauctivity Index , on which the children's classroom teachers 
were asked to assess each child on a scale of 1 through 7 in terms of such cri- 
teria as "pays attention to own activities when other things are going on" and 
"stays with job until he/she is finished." 

Or the vast majority of these tests of performance, motivation, and pro- 
du^ivity, the CSE analysts found no significant difference between the scores 
of t^e Preschool Program's graduates and the scores of their classmates. Here 
are the principal exceptions: 

—On the Cooperative Primary Test - Reading, administered it. the Spring of 
the first grade year, the Preschool graduates scored significantl v less welL 
than their classmates who had attended no Preschool Program. 

— On the Student Productivity Index , the Preschool graduates scored sig- 
nificantly less well in each of the three grades than did their classmates who 
had attended no Pv^eschool Program. 

—Kindergarten children who were graduates of the Preschool Program were 
absent a significantly greater proportion of the Fall 1973 semester than their 
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classmates who had attended the Children's Center pre gram. (In the other two 
grades there was no significant difference between the absence rates of the 
Preschool graduates and those of their classmates.) 

The CSE researchers performed additional analyses to supplement their basic 
study. One such analysis concerned the effect of enrichment of elementary school 
prograns on the performance, motivation, and productivity of kindergarteners, 
first graders, and second graders. The impact on children of a successful Pre- 
school Program might be "washed out" by an ineffective early elementary school 
program. To test for this possibility, the analysis grouped the children in the 
stucty by the degree of enrichment of their elementary school program. Those whose 
schools were receiving aid under fewer than three state or federal programs were 
classed in the "Lov/- Enrichment" group, and those whose schools received aid under 
three or more such programs (the maximum for any school in the study was seven) 
were classified "High Enrichment." 

Perhaps surprisingly, the students in the High-Enrichment schools in no cases 
registerel significantly higher performance, motivation, or productivity than those 
in the Low-Enri chment schools. In five cases, moreover, the students in the High- 
Enrichment classes registered significantly poorer scores than those in Low-Enrich- 
ment classes. This finding suggests that the enrichment programs might be detri- 
mental to the performance, motivation, or productivity of students, but the re- 
searchers--citing sampling limitations— cautioned against drawing such conclusions, 
because the s^ ools receiving more enrichment are likely more in need of it. 

Another special analysis performed by the CSE researchers concerned whether 
any particular type of Preschool Program proved more successful than other types. 
In the past, concern has been expressed that massive evaluation studies of pro- 
grams as large as the State Preschool Program fail to discriminate between the 
successful and unsuccessful versions of the Program, because they necessarily 
deal with averages, lumping together the results of a good Preschool agency in 
one area with a poor one in another. 

In an effort to discriminate between the types of Preschool s, the researchers 
asked administrators of the 42 Preschool agencies in the study sample to rank five 
goals and purposes for Preschool Programs in order of relative importance. The 
responses enabled the analysts to divide the Preschool agencies into three groups: 
20 which emphasized "Preacademic Skills," 11 which emphasized "Socialization and 
Interaction Skills," and 11 which emphasized "Attitudes to School and Learning." 

On almost all the measures of performance, motivation, and productivity 
used, there was no significant difference among the average scores of students from 
each of the three categories of Preschool Programs* The exception was in absence 
rates. In both kindergarten and first grade, children who had attended Preschool 
Programs emphasizing Social aad Interaction Skillc were absent significantly less 
often than those who had attended Preschool Programs emphasizing Preacademic 
Skills or Attitudes to School and Learning. At the second grade level there was 
no significant difference in the absence rate. 
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INTRODUCTION 



In 1965, the California Legislature appropriated funds for a state-wide 
pre-school program, to be partly federally funded, by enacting AB 1331, Chapter 
1248. The program was based on the Legislature's belief that "the introduction of 
young children to an atmosphere of learning will improve their performance and in- 
crease their motivation and productivity when they enter school" (Chapter 3, 1645) 
Since the intiation of the State Preschool Program, AB 451 was signed into law 
on October 1, 1973, and restated the legislative intent of the Program: 

The Legislature established the preschool program 
with a strong education component to prepare children for 
success in school, and declared that the program consti- 
tutes an essential component of public social services. 
The Legislature believes that the introduction of young 
children of low-income or disadvantaged families to an 
atmosphere of learning will improve their performance and 
increase their motivation and productivity when they enter 
a regular school (AB 451, Chapter 1005, Section 6). 

AB 451 also specified the Legislature's intent to investigate whether or not, 
and to what extent, "the present services delivered under the preschool program 
are meeting purposes for which the program was established and whether the 
program should be fully funded with state general funds" (Ibid). One component 
of the investigation was to be an evaluative study of the State Preschool Program 
success in achieving the objectives of improved performance, motivation, and 
productivity of children matriculating through the regular elementary school 
system ( Ibid , Sec. 7). The Legislature further declared that the evaluation 
should include, to the extent possible, "a retrospective analysis" of improved 
and sustained motivation, performance, and productivity in the early elementary 
years ( Ibid) . 

Evaluation Questions and Evaluation Design 

The Center for the Study of Evaluation at the University of California, 
Los Angeles, (CSE), was selected to perform the evaluative study. To fulfill 



its responsibility, CSE posed the following specific question that was intended 

to mirror faithfully the Legislature's intent, but that was framed in a way 

conducive to an evaluation design: 

Do children who previously experienced the State Pre- 
school Program for at least one year show significantly im- 
proved performance, motivation, and productivity in their 
subsequent elementary schools when compared with children 
who have either experienced other preschool programs 
(like the California Children's Centers), or have not ex- 
perienced a traceable institutionalized preschool program? 

This question called for comparisons among three different groups of 

children, as illustrated below. 



Children experiencing 
the State Preschool 
Program 


Children experiencing 
the California 
Children's Center 
Program 


Children with No 
Traceable Institu- 
tionalized Pre- 
school Program 


Performance 

Motivation 

Productivity 


Performance 

Motivation 

Productivity 


Performance 

Motivation 

Productivity 



In addition, CSE investigated an important aspect of the same children's 
continuing elementary education by asking whether their comparative performance, 
motivation, and productivity was significantly affected by the number of enrich- 
ment programs, both federal and state, in their elementary schools. 

The additional question called for another comparison to be made on the 
basis of whether the elementary schools presently educating the children received 
high enrichment, many sources of enrichment funding, or low enrichment, few 
sources of enrichment funding, or their regular educational programs. The 
question adds to the illustration, as below. 

To answer these evaluation questions, the comparative performance, motivation, 
and productivity of children currently in kindergarten (1972-73 pre-school class), 
the first (1971-72 pre-school class), and second (1970-71 pre-school class) grades 
in a sample of regular elementary schools throughout California was examined. 



Children experi- 
encing the State 
Preschool 
Program 



Children experi- 
encing the Cali- 
fornia Children's 
Center Program 



Children with No 
Traceable Institu- 
tionalized Pre- 
school Program 



Children receiving 
low elementary- 
school enrichment 



Performance 

Motivation 

Productivity 



Performance 

Motivation 

Productivity 



Performance 

Motivation 

Productivity 



Children receiving 
high elementary- 
school enrichment 



Performance 

Motivation 

Productivity 



Performance 

Motivation 

Productivity 



Performance 
Motivati on 
Productivity 



using an "after-the-fact" evaluation design. The findings formed the basis for the 
retrospective evaluation of the extent to which the State Preschool Program was 
successful in achieving its purposes during those years. 

CSE also anticipated that the answers to the above primary evaluation questions 
might not reflect a clear superiority or clear inferiority of the Preschool gradu- 
ates. In this event, the Legislature wou'^d not have enough information to make an 
unequivocal "yes-no" decision about continued funding. By merging all of the 
various Preschool agencies into a single group, treating them as an undifferentiated 
program, and seeking a detectable "State Preschool effect," CSE thought it might be 
overlooking information the Legislature would find useful. 

The answer to the primary evaluation questions, therefore, had to be elabor- 
ated, because "State Preschool" in reality consists of a variety of different 
programs and approaches. It was perfectly possible, for instance, that "no overall 
Preschool effect" would be found, when in fact some Preschool agencies had a strong 
positive effect, while others had a strong negative effect, with one cancelling the 
other out in an overr.ll assessment. The secondary thrust of the evaluation, there- 
fore, lay in providing an elaboration of the primary questions. For example, if the 
various agencies had different kinds of success, it might have been attributed to 
variations in their purposes and methods. Therefore, CSE had each agency classify 
itself according to its primary educational purpose. The results of the comparisons 
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among the types of agencies were then used to indicate which type had the greatest 
effect. This information was offered to the Legislature to enable it to make inter- 
mtidiate funding decisions, even if it decided that the evaluation information was in- 
sufficient for a "yes-no" decision. An example of the type of decision it might make 
couIq be stated as follows, "Fund the program, but mandate the adoption of the 
successful methods." 
Limitations on the Evaluation 

Limitations caused by the evaluation questions . CSE intentionally delimited its 
retrospective evaluation of the State Preschool Program by asking questions and seek- 
ing answers that conformed to the letter and spirit of the Legislature's requirements 
in AB 451. It did not address all of the important questions that might have been 
asked about the State Preschool Program. For example, the evaluation did not address 
the Program's effects on parental participation or the effects of medical or nutri- 
tional supervision. • It did not measure the impact of the Program on the morale or 
self-concepts of the children, their parents, or teachers. Further, because this 
was an "after-the fact" evaluation, CSE could not directly observe children in the 
Preschools to analyze various secondary mental health or social benefits. Many may 
find these limitations to be lamentable, but, in fact, their purposeful imposition 
provided a much-needed focus to the evaluation of so large a statewide effort. 

Limitations due to the evaluation design . In after-the-fact evaluative studies 
like the present one, conclusions are drawn about events that have already taken 
place and over which the evaluator has had no experimental control. These studies 
lack much of the elegance and precision of the traditional research experiment in 
which the investigator regulates conditions and directly observes events. If this 
evaluation, for example, had involved a more traditional experimental situation, 
children would have been randomly assigned to three pre-sc'^ool experience groups 
and the "roups would have been monitored over the three years. Random assignment 
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and direct observation would have permitted the evaluator to be completely con- 
fident that the findings were due solely to the influences of the pre-school 
experiences, rather than to systematic differences among the groups of children 
experiencing them. 

For example, the eligibility and selection standards of the State Preschool 
Program (designed to meet political as well as social needs) intentionally attracted 
children from families with particular combinations of disadvantaged economic, educa 
tional, and ethnic backgrounds. Because of their family's or subculture 's shared 
values and attitudes toward education, the children are likely to have responded 
to school in uniformly different ways from the children who had other pre-school 
experiences. Random assignment to the various pre-school experiences would have 
eliminated the prejudicial effects of such selective eligibility standards for the 
Preschool Program, but was clearly impossible to have implemented. Therefore, in 
conducting this retrospective evaluation, CSE had no choice but to accept the 
limitations of the after-the-fact design, and to develop procedures that could 
nonetheless provide accurate conclusions. 

The evaluation procedures employed incorporated currently available and care- 
fully reviewed techniques for selecting, collecting, and analyzing information 
in order to ensure arriving at the most accurate and objective conclusions about 
the State Preschool Program. The conclusions were based on the measureable per- 
formance, motivation, and productivity of children in regular elementary schools 
throughout the St^ce. Nevertheless, it must be repeated that the conclusions of an 
after-the fact evaluative study should be interpreted with great care. 

Additional limitations . California's State Preschools sometimes receive 
funds from one or more additional federal funding sources, like Head Start or 
Title 1 (Audit Report, Chapter 10, p. 73). In addition to multiple funding 
sources, services and children of the various programs are frequently commingled. 



Thus, in arriving at conclusions about the State Preschools, it was sometimes 
impossible to account for the effects of other, possibly significant influences. 

Another limitation on this evaluation resulted from the fact that some of the 
services and children of the State Preschools and of the California Children's 
Centers were commingled. Commingling was evidenced by shared space or facilities, 
or by children whose names appeared on class lists for both programs. Fortunately 
for the purpose of this comparative evaluation, such conomingling was unconmon, in- 
volving few Preschools and Centers, and thus allowing relatively pure groups of 
children to be established on the basis of their pre-school experience. Children 
on the records of both programs were eliminated from the study. 

The evaluation would have benefited greatly if "improvement" could have been 
more precisely assessed for each of the three types of experiences. But such pre- 
cision demanded baseline data, or quantitative information on the children before 
the start of their pre-school experiences. Such early information on the children's 
performance, motivation, or productivity, or even on their socio-economic status 
was, however, with few exceptions, unavailable. Without it, CSE could only estab- 
lish comparative relationships among the groups of children. It could not 
provide information on how far they had moved from their initial positions to their 
current accomplishments. Therefore, the evaluation was limited by an inability to 
detect whether or not the State Preschool children had "improved" slightly, but 
perhaps not sufficiently to show that their performance, motivation, and produc- 
tivity was at, or above, the level of children with other experiences. This 
additional limitation, resulting from the lack of baseline data, was addressed in 
the formulation of the evaluation hypotheses. 

The calendar below describes the sequence of events in which CSE moved from 
the evaluation questions to the evaluation study's findings. 
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PWJKT CALCtUAK 



October 19, 1973 
Octofcer 19,1973 
Novonber 19, 1973 

Novcmbtr 20, 1973 

Novcabtr 30, .973 

Deceaber 1, 1973 
Janunry 10, l^T^. 

J«nu«r/ 17, 197<« 
r*bruiu-y 197«» 

rtbruary 15, 197i» 
February l8, I97li 
ftbru»ry 19, 197'» 
ftbrutry 22, 197'* 

March 197<» 
March 18, 197«» 

April 1, I9'^«t 
April 5, >9?«» 

April U, 197>» 
April 29, 197 «» 
May lt», 197>» 

Kay 20, l97i» 

Junt 1, 197i» 

Jua* 3, I97i» 

July 1, 197i» 
July 31, igrju 

AU(U«t 1<2, 197't 

Au«uat 26, 197 >» 
Aucuat 2d, l97ii 
Stptwber 6, 1971. 



Meeting vith Pichard W. Brandam* and otbtra fro* th« Offica of tha Lafialatiya A»4lyat. 

Letter prcpoial for tJ.a tvaluatioa SluAy of AB li$l aubKJtted to Richard W. Brandma. 

Meeiinc in Ucraaanto with Karoia E. 3aio«ua of tht Office of the Leclilatiya Aa^yat 
tnA tack Houiden of the Oepart«ant of Idueation. 

fte-i.ed evaluation deaitn subaitted to Dr. Williaa B. Michael of the Unlveriity of 

Souihern Califort.ia for review*. 

Meeting with 5r. Mitheel ai USC for diacuaaion of poaaible refiaion of eraluation 
resign. 

Sknpllng ?rocedurea refined and UiplaeseBted. 

Meetlv, with Jerry tvana, Ugialative Budget Comittee, Office of the Legielatiye 
Analyat,at UCLA. 

Visit to Sacrenento to obtain Preachool Agency PEP 10 rorma. 

Me(rtlt;g vith the Greater Loa Angflea Coaaunity Action Agency, aupenfiaed by John 
R. Sheffer and Ella Moalaod. Vlait to Sacra»ento to get Racial/tthnic data -in Pre- 
achool Agenciea fro« Depart»ent of Sducation, Diyiaion of Prograa Iva^uation. 

Utter JoinUy aigned by A. Alan Poet and WUaon Rilea aent to '«»8 aaaple eli»«Jtary 
achoola. 

School Diatricta lent copiea of Jaintiy aignad letter and given the na»ea of elewatary 
achoola to be yiaited by CSE ataff. 

Firat written cOMunicetion vith the aanple Preachool agenciea, including Jointly 
aigned letter, requeata for roatera, and Preacbool Purpoae Survey carda. 

Letter to H8 aaaple ele«niary achoola introducing CSE, reiterating the purpoeea of 
evaluation "udy, and providing inforaatiun to teachera vhoae atudenta are to part* 
icipate in etudy. 

Meeting with the Covemor'e Adviaory Cowtlttee « Child Developaent PrograM. 

Pirat est Survey Kit eeat to echoola, baaed on roetera aekad for in lettere aent on Peb- 

ru&ry 18 and February 22. 

Piret pick up of CSE Sunray Kit by CSE field ateff. 

I'eeting with I>r. Villiaa M'.cbael of USC for periodic review of etudy deaign and 
proccdiirea> 

Kequeate for roatera eent to aaaple Cbildren'a Ceatera. 

Uet act of CSE Survey jcita aent to eaaple el«en«arT achoola. 

Obtained piychoaetric information or. R>tnf Level Teat froa Dra. Sheppard and 
Carlaon, Diviaion of Program Xhna*s.ation. 

Saaple agenciea aenf a fomal note of apprecietion tor their cooperation* in- 
cluding e copy of the CSE-BCBC Preachool/IUttlergartec T^at fvaiuetiona. 

Obtained coaputer print-out with &it.Tf Level T^at eeoree froa Weatinghouee Learn- • 
ing Corporation, 

Agency Purroao Survey coapleted. Field vieite to elementary achooli coapleted. 
Sehoole eent a formal note of appreciation for their cooperation, including e 
CSX Elementary Teat Evaluation book. 

Preachool roatera completed. Children'e Centera roatere coaplet* 1. 
Data Analyeie completed. 

Dra. Hoepfner and Pink attended conference aponsoied by the Early • lldhood 
Project, Evaluation Coamiaaion of the Statea in Boaton, H**,iichu»rtta: 
"Zmplwenting Child Development Programs". 

Preliainary Draft of Pinal Report coapleted. 

Meeting with Jerry Evans at UCLA. 

Review of Preliainary Draft of Pinal Report by Ms. Virginia Br-*m, Riverai<^e 
County Schools; Ms. B'llie twitter, Head Teacher, Franklin Sch>U , Modesto, 
Dr. Susan Runiedal, California State University, Long Beach. 



of Pioal Report by Paul Steiger, Los Angelea Tlmea. 



September 15, 197i» Review of Preliainary Draft of Pinal Report by Dr. William Michael. 

Septwber 30, 197'» Suhaiesion of Final Report of Evaluation Study to Office of tegielative Analyst. 

October 1, 197k Thank You Utter eent to all parCieipanta in the evaluation atu4y. 
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SAMPLING PROCEDURES 



Because the primary focus of this evaluative study was the effectiveness of the 
State Preschool Program, the sampling procedures for all three pre-school experience 
groups were mainly directed toward ensuring an accurate selection of former State Pre 
school children. In other words, CSE first concerned itself with obtaining a repre- 
sentative sample of children v/ho had experienced the State Preschool Program. Next, 
children in the other two groups were incidentally sampled, using the State Preschool 
cnildren as a reference point. Because of the emphasis on children, no attempt was 
made to obtain a representative sanple of pre-school programs or elementary schools* 
Sampling the State Preschool Children 

A multi-stage sampling procedure was developed to identify those children who 
had experienced the State Preschool Program. This was necessitated by the fact that 
first Preschools had to be selected for the sample, and then the children had to be 
traced to their elementary schools, and those schools, in turn, had to be sampled. 
Throughout the discussion of the sampling of State Preschool children, then^ it is 
important to keep in mind that three different sampling units were employed: the 
State Preschool agencies, recipient elementary schools, and the children themselves. 
Stage I: Agency Sampling Procedure 

The initial unit of sarr.:^ling was the agency, defined as an administrative 
unit receiving AB 1331 funds that was responsible for running a State Preschool 
Program. (Sampling on the basis of Preschools or classes would have complicated 
adherence to the three criteria listed below, and would have reduced the likeli- 
hood of identifying aJM, Preschool children at the second stage, because many 
Preschools feed their children into common elementary schools, particularly in 
urban areas. Although the State Department of Education supplied information 
that 192 agencies had been funded since 1970, the first year of interest to this 
study, a sample size of forty agencies was proposed as a feasible number for 
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evaluation. The following criteria formed the basis for a six-step agency 
sampling procedure: 

a. the length of time each agency was funded 

b. the agency's size, based upon the number of children enrolled 

c. the agency's geographic location 

Step One 

Of all the agencies that were funded by the original AB 1331 Preschool 
legislation, only those that the State Department of Education indicated were in 

operation for three consecutive years, 1970-1971, 1971-1972, and 1972-1973 were 
initially selected for consideration in the study. The selection served the 
purposes of permitting comparisons of program success through the years and of 
minimizing the number of elementary schools that would receive the children and 
consequently require CSE staff visits. 

One hundred thirty-five (135) agencies were identified as funded for three 
consecutive years. ^ 



Alphl Mppi Alp^i SororUy 

Alphi Hus Corpontlon Cbi Circle Vte^chool 

Al^^ Rock Union tlwienUiy School Oivtrict 

AiChihofese of los Angeles 

Aivin unjor. ScIkjoI District 

Benicu Con<«unity Action Council 

Berkeley HiHs Nursery School 

Beikeley Unified School District 

Ucrr/cssa Union School District 

Biirntwood Union School District 

eritt«n School District 

C3|on Villey Union School District 

Cdlexico UfiiMed School District 

Canfornii Stile College. H^ywird 

C*litorni4 Stile University, los Angeles 

Oipistr«no Union Sctiool District 

Cd^Ur} Villey Unified School District 

Ceres Unified School District 

Chuii Visti City School District 

Cottpton Unified School District 

Corcorin unified School District 

Cu^»ell»r)0 Elecienliry School District 

D«l t'fiO Htfiqhtk School District 

0«Pirtnent of iducition. Diocese <>f S4n Diego 

OepenJency Prevention Coffipisiion (DPC) of 

Sin '♦eminllho 
Oubnoff Center for Child Develop«ent «nd 

EJucition<»l Theripy. irc. 
icono«ic Dpportunity Boird (£08) of 

Riverside 

Lcono^ic Dpportunity CooKiission of Sin M«teo 
(ducitio«i Progress Center 
iscondldo Union School District 
txception<l Children's Foundition 
Fiirfield-Suisun Unified School District 
Firwersville school District 
First United Methodist Church 
Folscn Cordovi Unified School District 
freiwnt Unified School District 
f resno Unified School District 
Fullertot) Eltitncntiry School District 
Oilt loint Union School District 
Giiro^ Unified School District 
Golet« Union School District 
Crcaif' los An^jeles Comunity Action 
Agency ( GIACAA) 

Hinford (ln»ent«ry School District 

Utrlif Arei Ret4rded Childien s foui»d4t»on 



THREC*YEAft PRESCHOOL AGENCIES 



Wif^arii Uniiied Schnul District 

Htmct Unified School District 

Huohson Union School District 

County duperintendenl of Schools>Inyo County 

Jefferson Llementiry School District 

JuruPA Unified School District 

Kennedy (.hi!d Study Center 

K^min-i-loyd Union ne«efit«<ry School District 

Kem COfiXinit/ Colieoe District 

fPtn J!Q\t\l Union ingh School 

Keye* Union fle«*nt4ry School District 

td Habri Citv School Distt !ct 

U *'esi>>prin'i Villey )>ctiOQ\ District 

le^,oo Orove school District 

tindsiy Unified School District 

Udt Unified School Distr{:t 

Hideri Unified School District 

Mifundi Institute 

M3rin Cnunty Superintendent of Schools 
Hdrtinej Uf^ified School District 
Hirysville loint Unified School District 
KCKinleyRoosevelt Union Eleir^ntiry School 
Di'.trict 

Hendoti Union district 
Me<ced County Depirt"«nt of £«luk4ti0n 
Modesto City Schools 
K<>nroyi4 Unified Sihont Oistrut 
'V)ther tode Union Schn-»l District 
Ht Diiblo Unified :>criool District 
N4tion«l Sch(k)l District 
North S4Cr4'vnto School District 
NorthCiti Cilifornii Child nevelopr«nt. Inc 
Oikljnd Unified School District 
Cceinside Unified :>ch(>ol District 
Ontirio>'4ontciiir School District 
Orinfje Center Schools 
Oxndrd Skhool District 
TdCific Grove Unifitd Schools 
P4lem<) Union Ele<^nt4ry School District 
Pilo Alto Unified School District 
r4io Verde Union School District 



PlS4den« Connunity Sfryices Connission, 
Pisideni unified Sd*ool District 
Pitterson Unified School District 
Peter Hiurin NeiQhhorhood House. Inc. 
Pittsburg Unified School District 
Pixley Union School District 
Plicer Conntjnity Action council, inc. 



Inc 



RivenSMOOd City School District 
RictvBOnd Unified School District 
Rio Hondo Arei Action Council 
Rio School District 
Robli School District 
Sicrmento City Unified School OiUtict 
Silinis City School District 
San Benfto County Dffice of tducitlon 
Sin Diego Unified School District 
Sin FrinciSco CoiqBKjnity College 
Sin Jose Unified School District 
Sin Juin Unified School District 
Sin Lorenzo Unified School District 
Sin torenzo Villey Unified School Ohtricl 
Sin Luis Dbispo County Office of Iducitlon 
Sin Miteo City fle«entiry Schools 
Sin YSidro School District 
Singer Unified School District 
Sintt \S4rbiri County Schools Dffice 
of the Superintendent 
Sinti Cliri County Office of Educition 
Sint< CUri Unified School District 
Sinta Cruz C.A.C. 
Sinti Mirii School District 
Sintee School District 
Sh4Sti County Superintendent of Schools 
Sonota County Office of'Educatlon 
South Biy Unicm School District 
St«nisUus County Depirt«ent of Educition 
Stockton Unified School District 
Sunnyvile ^cliool District 
Tele<)riph Kill Neighborhood Association 
Tulire County Depirtnent of Educition 
Turlock Joint Union School District 
Ukiih Unified School District 
University of Southern Ctllfornii 
Villejo City Unified School District 
Ventur* County Heid St*rt Preschool 

Villi £sperinz« 

Mishington Unified School DistHCt 
Weiver Preschool 
Westminster School District 
Whissjn School District 
Uillits Unified School District 
rub< City Unified School District 
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Best copy availabu 



step Two 

The purpose of selection during this step was to ensure at the outset repre- 
sentation of the largest receivers of AB 1331 funds and thus, the major Preschool 
programs. It was decided that the inclusion of all agencies with a total enroll- 
ment of 250 or more children would satisfy this purpose. Ten agencies were selected 
in this fashion. Three of them, Dependency Prevention Conmission (DPC) of San 
Bernardino, Equal Opportunity Board (EOB) of Riverside County, and Greater Los Angeles 
Community Action Agency (GLACAA), were later identified as meta-agencies (umbrella 
agencies with administrative authority over one or more agency). Sampling within 
each mel;a-agency was then necessary. However, agency names for the respective meta- 
agencies were not available during this sampling step. 

The ten agencies selected in Step Two were: 
Compton Unified School DisT:rict 

Dependency Prevention Commission (DPC) of San Bernardino 
Economic Opportunity Board (EOB) of Riverside County 
Fresno Unified School District 

Greater Los Angeles Community Action Agency (GLACAA) 

Oakland Unified School Distr.ict 

Richmond Unified School District 

San Die^co Unified School Dist.-ict 

Stockton Unified School District 

Tulare County Department of Education 

Step Three 

All agencies not selected in Step Two were plotted on a map of California. 

Those located in outlying areas were selected for the sample so that it would be 

geographically representative. Six agencies were added: 

Calexico Unified School District 

County Superintendent of Schools - f.nyo County 

Northern California Child Developmor^t , Inc. 

Shasta Cowity Superintendent of Schools 

Ukiah Unified School District 

Yuba City Unified School District 

Of the remaining agencies on the map, several geographic clusters were visu- 
ally apparent. Sampling was performed within these clusters with the following 
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exceptions: (a) clusters containing the metropolitan areas of San Francisco- 



Oakland, Los Angeles, and San Diego were excluded because Step Two sampling yielded 
agencies in these areas, and (b) clusters containing the three meta-agencies iden- 
tified in Step Two were also excluded because sampling within them would occur whan 
their respective agency names became avail able. 

Ten geographic clusters containing 43 agencies remained, from which 12 agencies 
were selected on the basis of district size and number of Preschool classrooms, 

Arvin Union School District 

Santa Cruz County C*A,C. 

Goleta Union School District 

Hemet Unified School District 

Oceanside Unified School District 

Oxnard School District 

Palermo Union Elementary School District 

Modesto City Schools 

San Luis Obispo County Office of Education 
Santa Maria School District 
Sonoma County Office of Education 
Sacramento City Unified School District 

At this point 28 agencies had been chosen • 

Step Four 

Twelve additional agencies were needed to complete zr\e projected sample. They 

were selected randomly, using a table of random numbers, from all agencies not 

already chosen: 

Archdiocese of Los Angeles 

Exceptional Children's Foundation 

Monrovia Unified School District 

Rio School District 

Robla School District 

San Benito County Office of Education 

San Lorenzo Valley Unified School District 

San Ysidro School District 

Cupertino Elementary Unified School District 
Ventura County Community Action Agency 
Villa Esperanza 
Weaver Preschool 

At this point forty agencies had been chosen. 



- 15 - 



f fi025 



step Five 

Following Step Four, agency nanies became available for two meta-agencies (DPC 
of San Bernardino and EOB of Riverside County). Two three-year agencies were 
selected within DPC of San Bernardino, and two three-year agencies within EOB of 
Riverside County in order to represent district size and geographic area. These 
four agencies were substituted for their two meta-agencies, thereby increasing the 
sample size to 42. 

At this time it was also learned that one agency (the Barstow Unified School 
District) had been funded for fewer than three years. Victor School District was 
then selected as its replacement because it satisfied the criteria by which the 
Barstow Unified School District had been originally chosen. 

Step Five agencies were: 

Del Rey Foundation 
Needles Unified School District 
Palo Verde Unified School District 
V±ctor School District 

Step Six 

Following Step Five, the agency names for GLACAA became available and one of its 
three-year agencies (Los Angeles County Unified School District) was chosen on the 
basis of geographic representativeness and number of classrooms. This agency was 
substituted for GLACAA, The sample size remained unchanged. At this point, however, 
a representative from Los Angeles County Unified School District informed CSE that 
the District vtM also an umbrella agency. Consequently, a replacement agency from 
the GLACAA list, the Latin American Civic Association, was selected on the same 
basis. 

The geographical distribution of the final sample of 42 agencies is reproduced 
in Figure 1. 

In order to establish the extent to which the sample of 42 agencies charac- 
terized the population of 226 agencies, they ware compared in terms of their 
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Figure 1 



of GtAor«phlc OlstributiOft of Sinplt of FortyTw St*te Prtichool Agencies 




racial and ethnic compositions because of the importance of these factors to 
the ideals of compensatory education and because Information about race and 
ethnicity was accessible. To obtain the information, a letter was sent to the 
heads of all 226 agencies, requesting that they describe the numbers or per- 
centages of children that were American Indian, Black, Oriental, Spanish 
American, or Other White (racial/ethnic categories and names adopted from 
statewide statistical reports). The letter, completed and returned by 221 
agencies, is reprinted in Figure 2. 

The results of the comparison between the sample and the population State 
Preschool agencies are given in Table 1. 

Communications with the Preschool agencies . Initial contact with the 42 
sample agencies was made by telephone in order to introduce CSE^ explain the 
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Letter Sent to St«te Preschool Agency kopuUtion Requesting) R^cUl/Cthisu Infomation 
UNIV£nSnT OF CALIFORNIA. IXiS ANCIil.ES 




The Office of the LegisUtWe An«l>st of the St«te uf California h4s 
contracted with the Center for ttie Stud/ of Evaluation 4t UCLA for tft« 
purpose of evaluating the effectiveness of the State Pieschool Pro^ra^a 
tA3 1331). Because ycor a9encjr ^^as received funds fur the program mt aie 
reqjesting data on the racial cooposition of the preschool children In 
>Odr prograa for the Purpose of ccnparing our saaple with the total of 
all the funded progr«i.-t. 

' For jrour convenience* this form has been especially prepared for you 
to fill in the appropriate inforutlon. ije anticipate that nost agencies 
Mill obtain the data froa the aost receni Annual Statistical Report. Child 
Oevelopaent Centers, bat whatever tne source or oethod used. It should 
represent the total of all state funded Preschool children y^jr aiency has 
rtsponsibtMty for. Only Children wno are recipients of the State preschool 
;>rogr«« should be included. 





Knerican 
Indian 


)lack 


! 10- til 


^■■erican 


)ther 
<hite 


•iunber 
of 

Children 












Percent 
of 

CMldren 













You say fill in either the ntf^^ar of children in eac*i group or the 
percentage of c^:*dren in each grojp (or both if avait^ble). 



A lelf-addressed, Postage paid envelope htfs been i'^cluJed. u'e would 
greatly appreciate receipt of this inforcation as scoti as possible. Thank 
>ou for your cooperation. 



Sincerely, 




Uilliftft A. COnniff, Jr. 
Hestarcn Associate. California 
Preschool Evaluation Project 



Ubie 1 



(oK>arison c( *Z Uh>Iz St«ie Piescbo&l Agencies Miih 221 Uate 
Krescitool Agencies on the Basis of Their Racial a.»d ttfnir fonpoiitinn 





(Sarple) 
42 Agencies 


(Population) 
221 Aqencics 


Aotrrtcan Indian 




2.22 


B1<1C» 


22.70 


21.78 


Oriental 


1 44 


3.06 


^[^riSsh Htttncin 


31.75 


3S.87 


other Whit^ 


40 20 


37.20 



purposes of the evaluation study, and ask for nominations of elementary school 
that were likely to have received the most former Preschool students. The 
phcn6 call was followed by a letter to the administrator of each agency 



ERIC 



- 18 - 

0 0 0 2 8 



restating the purposes of the evaluative study, and asking for Preschool rosters 
for 1970-1971. 1971-1972, and 1972-1S73. This letter is given in Figure 3. 



mtrodu'-iOry ICttCr to State PrCSChcol Agency A(fe>iini$tr«tor$ 



CNlVERSrtY OK CALIFURNIA. LOS ANCEm 




VCL* Ca*K.*T< •CMKH, Or OVl ATI 

L0» •men m, CAummu «a*»« 



1h4nk you vtry wich for helping us obtiln the Infomttlon we need to 
conduct the C«lffomM Preschool Evt1u«t1on Project in connection with 
A8 451. How thit we ere beginning our study, wt wir. be contecting 
of the elewnUry schools served by tht State PrescNX)! Progr^ (A8 1331). 
One of Our first steps will be to send tfc* enclosed letter to school 
pnnclpels throughout Cellfoml*. Ue ere sending e copy of It to you for 
your tnforaetlon only. Hopefully, the letter cleerly eiplelns the «f»s 
Mtf purposes of our projKt. 

Me ere elso enclosing three self-iddressed. postcerd renling foras for 
you to fin o«t. As you cen tell frm thai, we «re Interested In detemln- 
Ing the pertlcuUr orientation of yoor Preschool progrea for eecti of the 
three years, ig70'1971, 1971-1972, end 1972-197? We would appreciate your 
filling out the postcards end proaptly returning the* to us. He realize 
that you aay not have been involved In the State "reschool Program during 
ell of those years, but we hope th*t you can mttt sopw Judgments about the 
orientation during each of the previous years, or ask someone who was fn> 
volved at that t1>e to sake the rankings for you. In addition. If yoj have 
not already sent us class fosters for each child ettending all preschools 
during the three y?ars, please do so «s soon as possible. 



Thank you ajain for your cooperation. 



Sincerely yours^ 



Ralph Koepfner 
Director 



Arlene Fink 
Assistant Director 
California Preschool 
Project 



Enclosure 



Included with the above letter were the Agency Preschool Purpose Survey 
postcards, which are described in the next section on Measures of Preschool 
Agencies, asking the agency administrators to rank each of the five possible pre- 
school purposes in connection with their own program's goals during 1970-71, 
1971-72, and 1972-73, and a copy of a letter about the study addressed to the 
elementary school principals in the sample signed by Wilson Riles, the State 
Superintendent of Public Instruction, and A. Alan Post, the Legislative Analyst. 
After CSE received the rosters from all 42 agencies, a letter of gratitude 
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was sent out, accompanied by a complimentary copy of the CSE-ECRC Preschool/ 
Kindergarten Test Evaluations . A copy of this letter is reproduced in Figure 4. 



Figure 4 

Think fou letter Sent 6y CU to ^»tite Preschool AQencies 



UNlVERSm* OF CM IFOHMA LOS ANCbl CS 




(iikfCJi ro« TMK rtvi/T or ■••iiaTIOm 



Thcnk you very >fluch for rtelping us obt<in the Inforaution we nttd 
for our C«MfornU Preschool £v<1u«tton Project. Your preschool <gtncy 
hi& iuppMed us with lists of ttenenttr/ schools currtntty tttendcd by 
your fomtr stiKlcnts. cUss registers of your foroer students, ind 
postccrds Indicating the rwture <nd enphisls of your progrta during the 
three ycirs we ire studying. Nc trt very grateful for the efforts you 
iod your staff hive extended In providing us with this Infonutlofit and 
wt would like to thank you for^lly. We hop* that the enclosed CSE 
Prcschool/Kindtrgartcn Test Evaluation book will serve as a toktn of 
our appreciation and that you will find the book ustful. 

We arc well aware that our evaluation findings nay have a direct 
bearing on ycjr program* so as scon as we have completed our studyi we 
will share our report to tha Legislative Analyst with you. Ue hope 
that you ftnd It an accurate reflection of California's preschool!, 
and that it will provide you with sone Information about your own progran. 

Once again, thank you for your generous help 

Slnce^ey, 

Ralph HDcpfner« Olr/ctor 



Arlcne Fink. As&istant Director 
California Preschool Evaluation Project 



A formal letter of appreciation, signed by Mr, Riles and Mr. Post was 
also sent to each agency. This letter is reprinted in Figure 5. 
Stage II: School Sampling Procedure 

The purpose of the school sampling procedure was to lielect regular ele- 
mentary schools, containing State Preschool children formally enrolled in the 
42 agencies selected in Stage I. 

School sampling consisted of three steps: 

1. Identification of the elementary schools that had enrolled the 
largest numbers cf former State Preschool children. 
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'tunk vou letct %t(\t by Hr Riles and Mr Post to Pjrt1cip«nts in the Study 




STATE 01 CAUFORNIA 

DEPARTMENT OF EDUCATION 

ni ciinoi uAu ucaAuorro «mu 



Octot>er ). 1974 



Ue want to t^«nk you for participating in the evaluative stu^y 
of the state Preschool Program undertaken by the Center for the 5tu4y 
of Evaluation at uaA for the Office of the LegisUtlve Analyst. 

The study required the assistance of mtny individuals and 
organizations throughout the state • teachers, aides, principals. 
Children's centers staff, school district personnel , and the staff 
of sponsoring agencies. He are very grateful for your cooperation 
and hopeful that the findings of the st(M> Mill Justify the tine and 
effort ycu contributed to it. 

The results the study Mill be reported to the legislature 
on Noveaber 1, as directed by Asscctly 8111 451 of 1973. This report 
ttill be reproduced in sufficient nunber to be eveilable for all who 
pi.*tfcipated, 

Once agtln, thank you for your contribution to this study and 
to the work of the Legislature In dealing Mith important questions 
about education In Cellfomla. 

Sincerely^ ^ 



Ufison RTies 
Superintendent of PubllcXInstructlon 



A. Alan Post 
Legislative Analyst 



2. Selection of schools that were representative of their respective 
agencies in enrollment size 

3. Selection of schools that were representative of their respective 
agencies in racial and ethnic composition. 

Step One 

The heads of State Preschool agencies were contacted by telephone and were 
requested to nominate up to eight elementary schools that were most likely to 
have received the largest numbers of former AB 1331 preschoolers. A telephone 
interview form was developed for the purpose of obtaining this and additional 
information required for the study. The form appears in Figure 6. 
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Telephone Interview fom to Obtitn Elewntary Stt.ool SiH>le 



ContKt Person , — 

. , ^ ^. 0»tes Conucted^ 

TiUphofti No ^ — 

ARFMCY TELEPHONE CAllS 

The following informitlon should be obt.lned or co«i«untuted during the inftf.l cont.ct 
wUh the Agency Coordinator. 

1. Mk for the current cwrdln.tor (heid of ill) of the St.te Preschools. 

2. Identify yourself ind us to the agency director: 

CiKfornfe Preschool Eveluitlon Project » UCLA . # ,k. 

iSrilng ilth the Stite Oepirt«nt of Educitlon ind the Off ke of the 

LegisUtwe Analyst for the legJSliture . 

Purpose: To fJnd out how successful Stite Preschoois ire 

3. F.nd out whether igency wis funded during 1970-1971, 1971-1972, 1972-1973? 

4. Ask for the nui<>er of preschool locitlons for eich yeir: 
1970-1971 

1971-1972 

1972-1973 

5. For eich yeir. which elewntiry schools did the Preschool children go to? 
The 1970-71 Preschool children went to the following eleiwntery schools: 



The 1971-72 Preschool children went to the followfng elementiry schools: 



1972-73 Preschool children went to the following elementiry schools. 



t«TE- If fM Agtncy Coordlnitor cinnot give you * list of the tlejenurjr schools, 

6. Tell Agency Coordlnitor thit we will be sending hWher i questionnilre for 
nor* InfonMtlon. 

isk them to send the« to us. 



In brief, the interview form enabled the interviewer to: 
- 1; Check that the agency had been funded for the past three years 

2. Request the names of the recipient elementary schools contain- 
ing the largest numbers of former AB 1331 children for each of 
the three years 

3. Notify the agancy that CSE would be forwarding a questionnaire 
requesting additional information about the agency's Preschool 
objectives 

4. Request Preschool rosters for each of the three years. 
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The elementary schools nominated by the agency heads were checked against 
data in the 1973 California Public School Directory to ensure that they en- 
rolled in kindergarten, first and second grade students since the AB 1331 recip' 
ients in this study were in those grades at the time of sampling. In a few 
cases, schools originally nominated by agencies were replaced at the request of 
the district or agency. These changes included: 



S»-eet in Blsliup repUceJ Olwich* tr. *nyo C«>,uniy be*. a> 
''o Afi !)31 children 


»« 0!«ncii»j re 




Sunnys!op« vai selected t.*) rrprcsent S«n eeitito »inc« the 
HoUliter District had not received A6 1331 children ttlc. 


yther !S^hooii 
t^e IhlM .1 




CjQfc replaced Bruce for Sar.la Murx» because it re^etv<^: 
than bruce, which Is a larger «chco]. 


ft ^rc»''hj<'i 


.111! >rvu 


John J Doyle replaced Bellevlew tr Tulare »t the disi-K t^jue*' >» 
B*ll»vlew received fewer, less repreieiitat jve chlidreri thtoti Doj^v. 


■ (.C 


Pierpont replaced Sheridan Vay in Ventura l«cau»r tliei t la« 
Intemedla^e School. 


ftty t< I a 




In Sacranento. >ruU Kld>re, Jedediah Snltt. and E41d|ie r 


ef'.aetd I.* * 




Sear Fla« and Colona because they hav« l*TitT r^palttlcn^ 


1 { ex-tji «sch4s/lei s 


Redwood Valley in Uklah wa& ndded sinc< Cai2*^ila n^t 
Redwood Kindergarten acudents tu Calp«lla. 


h^k/" li Ml >Hfi 





Step Two 

Representation in terms of size of enrollment was provided by selecting 
two large and two small schools from the lists of recipient schools nominated 
by each Preschool agency. There were, however, exceptions to this policy. 
Some agencies had nominated four or fewer recipient schools. When this happened, 
all the nominated schools were selected. Other exceptions were those where 
enrollment sizes were so homogeneous that it was impossible to meaningfully 
distinguish between large and small schools. In these cases, racial/ethnic 
composition became the selection criterion. Thus, the sequence of Steps Two 
and Three in the school sampling was sometimes reordered. 

Step fl^ree 

Recipient regular elementary schools were included only if theit racial/ 
ethnic compositions were similar to that of their "feeder" Preschool s. The 
racial/ethnic composition of the recipient schools was obtained from the 
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1970 Directory of Public Elementary and Secondary Schools in Selected Districts 
Enrollment and Staff by Racial /Ethnic Group > The racial /ethnic composition of 
the Preschool s in each agency was obtained from the 1972-73 Statistical Report 
which each agency had filed with the State Department of Education. 

One hundred forty-eight elementary schools were selected for the sample* 
They are listed by Preschool agency and located by school district. A map of 
their location by-district is provided in Figure 7 to graphically illustrate 
their geographical representativeness. 



Figurt 7 

Hip of Geo9^lp^^c Locttlon of 148 SMple Elcmtntlry achOOH by Ofstrict 




In order to establish the degree of similarity between the 148 sample 

schools and the sample and population agencies, the schools and agencies were 

compared in terms of their racial and ethnic composition. The State Department 

of Education provided CSE with copies of the current ethnic composition of the 
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BEST COPY AVAILABLE 



r « . ' I t . ftt j; , 
A'.'S rvul COfiP)NI?» ACTION AGif.Ct 



•'j>*'0 V<l ley 



joint Unified School DiSf' 



<drt4 Crui C'tv Eler.cntAr/ School C'Mtrix.t 

CO«PTON_ U HlflEO ^^CHOOL 0ISTB!>7 
Compion Unified School (Jiit^ict 

''i ^Dt-ES U NIflEU SCHOOL OISTRICT 

Nteilcv Unified School District 
O 5tr4.«ft eJcMntjry 
•<r«c« McnJvrson EltmmntTv 
Vi&Cij CoJor^do CJMwncary 

yiCTOR SCHOOL OISTRICT 

Victor School District 
UfJ ff«y e^ra«nt«rv 
VmvFt KnollM CJMnrnC^ry 
(rwi/i cJwavntary 
fjrJc vj«w sj«i«i«nt«ry 

PALO V EROE UNIFIEO SCHOOL OlSTBlCT 
PjIo Vcrd« Unified Schoc< District 

MdfyjftfC vftiCtf fJ*ii*nc«ry 
irutA Brovn SJvMnt«ry 

OEL Hi f OUHDATlOH 

Deicrt Sands Unified School District 
ft^rtin V4n turen Civacnc^ry 
ThciXiorv ftoosmvlt £J*mnt«ry 

ExCEf T l OKAL CHILOBEN'S FOUNOATIOW 

lus Angeles Unified School Dittrlci 
Altd Lom ffi*Mnt«ry 
Saturn Street Hm»nt*rv 
S4tA ^tre<>t EJ«Mnt«ry 
l22n<J »troet fJemntery 

f kHHO UNlflEO SCHOOL OISTRICT 

Fresno unified School District 
ffejton iivMnCjry 

Lincoln CieMnCAry 
Tittlntn CJeMnC«ry 

GOLETA UNION SCHOOL OISTRICT 
Golet« Union School District 

Cjt/MtfreJ rJeaencery 

tl Ctmino f/tMntery 

Oolmtd Sl»mntMrv 

Ut p«cer« rJemnUry 

LATIN AMERICAN CIVIC ASSOCIATIOK 

Los Angeles Unified School District 
tferc ecreet rJenentery 
O'Mmlvmny CJMMnC«ry 
pjooiM £l*m*nt»rv 
S4n t9rn*nJo tl»mntST'j 

Htm UNIFIEO SCHOOL OISTRICT 

HMet Unified School District 
hmmt ei»mntsrv 
ticeJtf L*k» tlmmnury 
lUmon* Sltmntsrv 
t/tiittiT lltmtnfry 

CWHU SUPERINTENOENT of SCHOOIS-IHYQ COUNTY 

Lone fine School District 
U/'tnvo eimmnfry 

•ls^op Union Elenentery School District 
tlm dtrMC CJeaentery 



SORTHt R_*< CALIFORNIA CHILD SFV ElOPHENT, INC, 

Plon^t Unified School District 

^rreMiUe Ci«fnentjry 
Red 8»uff Union Elemeni^ry School D.^tnci 

Jd(.-kson Hvigfts EJe»#nt<ry 
$ui4nvi))e Elementary School District 

«fcA,inirv fxenenC^ry 
Vestwood Unified School District 

FlttchT WlkT Cieinent^rv 

OAKLAND UNIFIEO SCHOOL OISTRICT 

Oal^LUnd Unified School District 
:<ocJcwood Ciepentery 
Meirose CieMncery 
Htlpfi J. tuncho CJemntery 
5tonehurft rj«««ntary 

OCEANSIDC UNIFIEO SCHOOL OISTRICT 
Oceansidc Unified School District 

0itMr CJeMntary 1 

UureJ CJeaivnt^ry 

Libbv CJencn tery 

MifMxon Elem»nt4r<i 

OXNARO SCHOOL DISTRICT 

Dxn4rd School District 
Ju*ni tt CJMwntery 
XeMJe CJMMntery 
/ferine Mst rJeMntery 



PALCRMO union ELEMENTARY SCHOOL OISTRICT 
Drovlll* City ElMentarV School District 

Cestsjde rJeaentery 

O^kdtltt tfejy/ite CJe*Mntery 

Pelermo Union Clenentarv School District 
H9l»n M, Wilcox rJMientery 
fMlTma CJevientery 

RICHMONO UNIFIEO SCHOOL OISTRICT 

KIcheiond Unified School District 
teyvicw fJemfntery 
Cortoz fJeeienteiy 
Lincoln rj»»i-mtery 
Per«r ;rJee«ntery 

RI O SCHOOL OISTRICT 

Aio School District 
tl /rio fJeeientery 
Kio H»t* EJeewncery 
Rio KeeJ fJenentery 

RQ8LA SCHOOL OISTRICT 

Rio Linda Union El*«entary School District 
ATOhdvn fJeaentery 
fruitveJe fJementery 

Aobia Sch^l District 
Mbl* £J««e/it«rv 
teyJor street fJemntery 

SACRAHEIITO CITY UNIFIED SCHOOL OISTRICT 

Sacrencnto City Unified School District 
frgit Ri<Sg9 fjeaentery 
J»a»di*h Smith XJenentery 
0*k Ridg» CJeeientary 
et/iei Phillips CJeeientery 

SAN BENITO COUNTY OFFICE Of EDOCATION 

Holllster tleetentery School District 
SuAnyeJope fJeiMr^^ry 

SAN OIEGO UMFIEO - ^ , OISTRICT 

San Diego Unified School OiiCriCt 
iMltoa tJeacntery 
Btndini fJeMnCery 
CrocJtett eJeNMntary 
StocJtton fJeMintary 

SAN lOftENZO VALLEY UNIFIED SCHOOL OISTRICT 

San Lorenzo. Vel ley Unified School District 
iouldsr Cni»k fJeMntery 
Ou*il Holloa eie«frntary 
5en torenso fieMentery 



L^Ci* H4f U-^if-ed Scf.ool OiStfiCl 
<4div>>'tt H^t.oe CivAentery 
\,l<.r<o lit Ttritary 

YU pBQ SCHOOL DISTRICT 
Sen Y»idro School District 
8ey*r Citn»ntjry 
Sfftytrtt tJwwenteri/ 
rii^lou lieaientery 
Ue Wjrede CJe/wntery 

CuPERTItiO UNION ELEMENTARY SCHOOL OISTRICT 
Cupertino Umon Elementary School District 

£V3y]c CJeoientery 

'.mtdon Cecw lJt.mr/)tary 

SA NTA HARIA SCHOOL OISTRICT 
Sente HArie School District 

Alvtn A/«nut. IJeMntery 

Coo* fJwjeenteri- 

feirJawn CJem^ncery 

Ctlvm C deicJuy CJcaentery 

SHASTA COUNTY SUPERINTENDENT OF SCHOOLS 
Cescade Union Eienentery School District 

V9rd9 V^lt cJenentary 

N94tio^ I^ne £i»Menc4ry 
Acdding Cleeitntery School District 

Menzenite Cie«iNrntery 

Sycaaore fiementery 

SONOm COUNTY OFFICE OF EDUCATION 
fetaluma City CiMwntary School District 

Cherry I'eJJey fieewntary 

V'eJJey V'lSte trienentery 
SonOiM Valley Unified School district 

CI Vcr*oo CJeeient«/y 

Saeeertni riewen'e ry 

STOCKTON UNIFIED St.H0OL OISTRICT 

Stockton Unified School District 
Crent Cieewntery 
King CJewentery 
Te/t eJeewntery 
reyJor CJeaentery 

TULARE COUNTY OEPARTKENT OF iOUCAT ION 
Cutler-Orosi Joint Unif'ed School District 

CutJer cJe«entery 
forterville Cle<n«ntary School DistrJCt 

John Jey OoyJe eie«H/ntary 

Woodlalie Unified School District 

VOOdJa>ce £itfai«ntjry 
Pleasant Vitw Clementery School District 

PJeaeent Vie« fJe»entery 

UKIAH UNIFIED SCHCOL OISTRI CT 
Ulciah Unified School District 

CaJpelle CJeai^Dtery 

Frank 2et.A eJementery 

OeA Menor f Jt.'/iwnteriy 

yoAeyo lU-mtnt^iy 



VENTURA CQUNIY_ COMMUNITY AUJOJ COIMISSION 

Oinerd Scliool ^i^triCt 
KAmna t U-fi^ niej <y 

Veni.vre LnitieJ School Ui^tnct 
titttfxinx £l*MrHnt.4ty 
t I FtwlKT I t»-nitntat'j 

Sim« Vel Icy Uni f led Sci'Col District 
PjrA t'icw Lib^wntery 



VILLA ESPERAHZA 

Pesedene Unified School District 
tfeeiiiton h'tiMt'j 
Jtff^rson tttm^rtj 
Roo*ttv*lr tlvm»fnt*fd 



WEAVER PRESC HOOL 

weaver Unton Eleetenter/ Scho 



YU8A City UNI MLD^jjQjH t>ISTRI fT 
Yuba City Unified School District 
f»rk ^'tK-y eirmfntAfv 
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elementary schools in the sample. The similarity between the school and agency 
samples and the school sample and the agency population can be seen in Tables 
2 and 3. In no .case did the percentage point difference exceed 14.68 points, 
and this happened for the category "Other White." This particular sampling 
discrepancy is understandable in terms of the flow of children from the socio- 
economically restricted Preschool s to the somewhat more integrated public 
schools. Further, the category "Other White" is admittedly vague, often serving 
as a repository for children whose racial and ethnic membership seems difficult 
to establish. 



Conpartson of A2 ^titt Preschool A'jencies with 148 Sdntile 
lltfientary Schools on the Ktsis of Their tttci*) «nd tthnic CQmpo^lttoft 





42 AfjenciCi 


(Simple) 
148 Schools 


Amncdn IndUn 


4.37 


95 


BIdCK 


22 70 


18.07 


Oncntdl 


1 44 


91 


Spinish AneriCAn 


31 75 


26.02 


Other White 


40.20 


SI 88 




Tdble J 




C(/«p<rison of 148 Sdmple Ht*^r\tArf schools with 221 bt4te 
Prescnool Agencies on BisU of Their Riciil ind Ctiintc Cuippoiit 




(Sarple) 
MS Schools 


(PopuUtion) 


^nfricdn tndun 


.95 


2.22 




18 07 


?1 70 


Or)«nt«l 


91 


3 06 


ipanuh A-»eriCirt 


26 0? 


3t> 87 


Other White 


51 86 


37 20 



Communications with the Elementary Schools 

From the beginning of the study. CSE accepted its responsibility to keep 
all participants informed of the purposes of the study and their roles in It. 
Each phase of the sampling and data collection was therefore accompanied by 
personal and written communications from CSE staff. 
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The principals of the 148 sample elementary schools were notified of the 
study, introduced to CSE, and informed of the demands to be made on them and 
the teachers and students in their schools in a letter jointly signed by 
A. Alan Post and Wilson Riles. This Ictte-* is reproduced in Figure 8. 

This letter was also sent to the Superintendents of each district contain- 
ing elementary schools in the sample. It was believed that the purposes of the 
study and the possible interruptions to the normal classroom routines resulting 
from visits by CSE staff, or the administration of the study's measuring instru- 
ments, would be of interest to the Superintendents or other district personnel. 
Superintendents were also given a list of the schools in their district that 
were to be involved in the study. A copy of the letter sent to the Superinten- 
dents to accompany Mr. Post's and Mr. Riles' letter can be found in Figure 9. 

Ftgurt 9 

Letter $tnt to $up«r1nttndtnts of Dtstrfcts Contilnlng 148 S«mp1t Ctc«cnt«ry Schools 



UNIVERSITY OF CAUFORNlA. LOS ANGELES 




rtKTW n» Till tTv» ttt 4«»>w»T»o% 



Th« C«nt«r for th« Study of £vi1uit1on hit been «&ked by the Office 
of th« Le^lslitlv* Analyst* with the coopentlon of the Stite Oep«rt*k«nt 
of £ducitlon* to conduct i study of CillfornU's State Preschool Progr«r< 
The study* Mendeted by Assembly 8111 451, reoulrtt thit we ermine the 
•ffKts the ProQrio has h«d in improving student perforciince* pi^oductlvtty, 
end MOtlvetlon in the eleNentery school. ^ «re therefore conticting the 
following principals of eltAtntery schools in your District to hein provide 
us Kith InfonMtlon: 

1. 
2. 
3. 
4. 



In Order to fully ex^UIn the nature ind Purposes of our itu^^'. ttzft 
principal Kill receive the ettiched letter Ufit\t4 bv A Aim (>ost <nd 

UllsoA itles. which «e ere enclosing for your Information During the ne>t • 
fewMnths* wt shall keep you Infomed of our activities in your District 
and of our coMnunlcatlons with principals an4 teachers If vou have 
questions about our study* please feel free to call Or. /rime fink or 
Dr. Ralph lloepfner at (2li) 825-4711. 

Sincerely yours, 



9a1ph Hoepfner, Director 



Arlene Fmk. Assistant Director 
California Preschool Evaluation Pro)«ct 



Enclosure 
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$«t fcy in« P*r. Fott tD Pr1nc1p«l of 1« S»«pU £lwi«flt»ry School* 




STATt OF CAUrOMflA 

DEPARTMENT OF EDUCATION 



Mm( VMr tht ailfonU Sutt U|ltUtur» vlH h««t to mU difficult 
dtcUloM •ko«i tk« fu»4tA» of our •4ge«ilo«al fro|rMi. On* l^rtMt 
oMttio* Uln$ ••hU tM UfUUlgrt it coMl4«rt ¥te«Cb«r lo cm* 
tUut fgo^lnt of tk* 'C^ii^A »rMclM«l »ro|rM U. cffMClvt 

th« kMn for th« cJilUr** cf Callftmur TH« Office of tM 

UalaUtlvo iMlytt Km coatr«cco4 vlch chi C«nt«r for tM Icu^y of 
IvolMtle* to flii4^tn onoMr lo ihU ^mcIm. X« ihH •it*^^. Hi« 
Coator will •tu4y chlUron lAo ort ^rMMCly U th* lilM«rMTtM. 
flr«t oirf mcmU gfi— of CsUfoniU'o ocliooU. W« oik T^r cMHr«cU» 
In •ttUtlnt tht Coattr't tuff U tho colUcClon of •4uc«c1om1 Inform* 
tlon skout th— chlUrtn. I«c«ua« «• U ••croMnto Uo ataff «• 
Conttr for U^iy of CvoImHoo ort vory muh Mr« tf iho »rM«iir«« 
«^ tlM coMtrolntt fUco4 up«n th« •telnUcracori m4 CMchoro U ywir 
• chool, oYtry ottM^t U " tcMovi y»«r n«cMMry e»6for«it«« 

whlU Mklni f«w 4Mfta4t u^a your tcoff HMlkU. • 

Tht Ctntor for th« Stu«y of tvilu«tloa Km 4«v«1om4 • Mil ^"•••l 
vltlt yUn for collictl&« thv MtoforUo of InforMCloA-. 

1. cut* lto»f r» . CurrMt clMtroos rMttr* (iht n«M of (h« (Mchor 
•nd MCh chlU la • clMi) for ovtry UMorMrtM, flrti, •mi tocoM grUi 
clMtToos In y»«r itbool. (Tor tdioelt vUh vn(r«4«4 or cmIi1m4 cloMOi. 
cho Contor will n«o4 TMCiri for oil cUMroow conc«lnl<kg clill4rf" 

thoii sr«4M.) W« rofUMt that ymi Mil th* coovltto4 rMtoro ^ N«rck 1* 
1*74 to: 

Or. Arlino fink, Aotlttnnt Olrtctor 
rrMcNMl tvtlwtlon frojact 
Contor for tht •ttt4y of tvaluatloo 
UCLA Cr*4uat« School of C4uc«tlo« 
U« AM«1m, Colif«r»U 90024 

2. aurw of AttltuiM . To o^UU InforMtU* on th« chll4r«n*« •ttltu4M 
toMr4 ochMl Mi iMtmlnC* tho CMttr will vr*vl4« Mch kla4erMrt«n, flmt, 
••4 tocMd |r«4« ciMttM tMohtr with • M«»Ut« mU ••MnlttorlKi 
H«k««« ihart ^tlMMltM <Mi«M4 MH«Ully for youne chll4rM. 

Tts »MlM«MMlrM will t«k« M Mr* dM tMaCy alMtM f 4Utrlkttt«, 
•uHtvUo, M^Uti. oW MllMt. X» •44ltiM, th* CMtor will •m4 Mai 
of tko tMCkora lnv«lvo4 • brUf fern f*r rctUf th« chll4rM't •ultutfM. 
Thlt r«tti« for* will n^if m Mr* thM filtM* «ltMtM of th* tMcMr • 
ttM. chlUrM'o ^oMtloMtlrM m4 th« tMohtrt' rntlni forM will k« 
Mllo4 to yov lor 41ttriWtlM ky clMirMS bMvMii mrch 1$ •n4 )0, 1974. 
Co^Utt InftimttM for mU clMirMs tkmU U •kt«lM4 ky A»rll 15, 
1*74. •id »Uco4 In tho ockMro Mln offlM ti b« c«ll*cto4 ky • vliiur 
fre« tho CMtor for tM itu4y of r:=!*^tlM. 

3. ychaol InfyrMtl^n . U Uto mrch 1974, Or. fink will coll you ti 
mU on •»KlAtiwBt f«r • Mifror of tho CMtor'o itoff f vUlt your ichMl. 
mo vUltor will hovt four rMfMoibllltiM: 

A, to colUct tho c«^yUto4 cllll4rM'« nttltu4« ^••tlennolrM •tiro4 
In tho ocfcoero mU offlco; 

k. to colUct tho c«i^toto4 tMckori* rotlnf ferao •toro4 lo tho 
•chMl*t Mln tflUt; 

c. to tronocrlho nt'M4M<i roMr4* lor Mch chlU for tho Toll 
•OMttor of 197)o74 fro* thi offlco ••crotory: 

4. to tfwucrlho ocorM fr«« tbi otoa4«r41»o4 ochlovoMot tMti ftr 
oil •tu4Mtt wko hovt ouch ictrM. 

Or. rtnk will conttct you shortly to Mowor n»y ^MtloM you My hovo 
ohout tho ^roM^otloo of clMt rMtort, tho •4BlolitrotlM of tho chil4rM'i 
^•tlonnolrat m4 tho tMchort* rotUf fom, oa4 tho colltctloo of tho 
otton4«nco on4 oton4or41co4 tttt InfaiMtlM. 



Slncoroly. 



wxLsoM inis 

luHriatM^' ot T^kllc 



c Xno^vctloA 



A. AlAM rOtf 

Ugltlotlvo Aoolytt 
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The letter sent to the elementary school principals by Mr, Post and Mr, 
Riles was accompanied by a letter from CSE to introduce the Center, reiterate 
the purpose of the study, and to emphasize the need for current class rosters 
for each kindergarten, first and second-grade class in the school • The letter 
from CSE Is reprinted in Figure 10» 



Figure 10 

IniroJtfClory letter to 148 SMple Clcff«nt«ry Schools 



UNIVERSITY 01-* CAtll-'OllNlA. LOS ANCEUS 




Th* Orric* of th« UflaUtlv* ArwU/at «n4 ttM St«t« DtpMrtiMnt of Uue** 
tlon h«ra Mktd u« at Uw CMttr for tim Stu4y of EvUuAtlon to aMttlM tho 
fffactlfaMtt of California** 8t«t« Pr«tcboola. Aa Kr. ^Mt mA Or. 9ll«a 
ripUlntd In tMlr Ittttr to you, tM akaalnatlon ra^ulraa tba C*nt«r ft 
gathtr InforMtlon attout chlldran vbo tr« prM«ntljr In klndarcartan, tM flrat 
w>4 ••cond cradfa. u« tMrafora naad your aaalataaca. 

To f«t ut ttartt4 tn coUactlnf tlw laforMtlon, tha Caottr la r««utatlo( 
that you sand curraot claaarooa roatara (th« naa* of tba t«*ch«r w4 aacb chllil 
in « eUia) for aach klndarfartan, rirat and aacOfw! st«A* in your tcliooJ. Vt 
*Mk that you nail tba cc«plata4 roatara tv Kwch U 197« In tha ancJoiad pra- 
p«ld tpvalopa. 

Aa apactriad tn Nr. foat'a a.-kd Dr. RUaa' Jattar» va vtJJ aJao M Mkln< 
iilndar«arten> flrat and aacottd (rada taachara to adalnlatar a ahon <x»aatlOA* 
nalra to tttclr atuJaota •nA to copplaU a brlaf r*tln« fo/* tbarafora, m 
will aoon M aaodlai yuu CSC Surray Klta containing thaaa ^^^-srlv^a t*ir fch 
cUatroott. K-?. Va raallta that clMaroo* taachara vlJJ pJa^ a YVlft. >ol8 in 
balplnc ua to obtain tha InforMtlon w naad. Wa ara tharafora artcXoair^ «oplaa 
of a daacrtption of tha ourf»«»a «nu Mtura oi our rraachooj hro'tft for you to 
•tw« thea 

The Canter will aoon contact you to wall* tut*t,i*mtt,V* for t*ia of our ata^ 
to vuit you to collect attandtncr and achlavwant InforMtlon, 4loof vixh th« 
coapirted CiSi: $*iTrrt Klta. Tbt Suparlntaodant of SchooJa In your dlttrUt hM 
alio racal««d a copy of Nr. Poat'a *nd Dr. RUaa' latter ao that ha luMva that 
04ir (taff will tM rltUlne your achool. 

U« arr w«-ry ^rata^ul for your cooperation. If you tiave Any »uaatlona about 
tit« ^e^arattun of xbm eUaarooa rottera, or any otMr aap^ct of our projact» 
pleeae fael frcft to call u< at (213)&?^^^11. 

Stncaraly yvjra, 

r«lpri lloapfner, l>lrector 



Arlene fink, Aaatatant Director 
California frtachool tValu»tlon frojaat 



As can be seen from the contents of CSE's first contact with the sample 
elementary schools, principals were provided with a written explanation of the 
purposes of the study and the teachers' roles in it. These explanations were 
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specially printed for distribution to the teachers by the principals if it 
was felt that further information about the study was needed* The written 
explanation is reprinted in Figure IK 



IntooMlton for PirllclpiUng T««cNer* 



IJNlVCiibm OF CAUFOKNIA. iX)S ANOELCS 




WHO AfiC V£ 



7kt CoUtA io\ tkt Study oi (vAtuAUon UCIA ia a KU<aKCh and dtvUop- 
mtiU ctAtt\ dlvQtvl te tkt OitoK^ And pKtcUct oi cduCeLtXot*^ tvaiuotion. 7fiu 

ccmdu.: < «JCiitfy oi tht mtcUvtnu* <ji CaUioXruA** $t«tc Trttcftool rro^r$m, 

NHT MC N£EU TOUR HUf 

o| {«w joncttu 411 MicA <0 ht/p moM"! rf.bR 4uecu4 tttJKntWitf 

Uhoot. U ttacktxt oi UiMfOMAif Ack^U thUd\tn, you «c in tht btU |V44ft9fT 
^ knau Oil ttttnt to «i4ich tki pAo^Kom ku bitn iuecui^U <a ac<Ucwiij </4 

HOW TOU CAN HCIP US 

In M(/m t0 obtMn tXt- **itAfmJtAon h« nitd, tkt CtnltA ioK tkt Stud,j d 
t\fatuAtion luu pAtfjoAgd tlu CSC Survt/ Kit co»ita4ivuij) & bAAti <mUUonttMAt iv\ 
you to fivt to yotM And a ^kt^U xtJUng (oam io\ you tc comptiU. 

Antict f rn t t tkaX tht ^uuttonnnAt taU AtquAAt <6ouX tmnty mimtu oi ycut ctatt 
ti^ And tkt AAUn/i io%m AboiJit ttn muvXl*. ^t tnJtt 6t binding (kt K</ to i/cii, 
AJtong **Uh comf>tttt ^nAUxtcUon*, m Ibuch. 1V4. $<nct wr knt/M ho*< diHuuU 
iX 4A to ad;u4t ctxiMtKw icktdulUt K< wU/ wkf fvt^y atftK^f f« 

6c 4U itcx4Mt «4 pouiMt *n AAAsng^ng i&A fkt coUtct<cn •<< x>i<ft<iwit<oM 0/ 
y^tt% 4cftoot. 

Thanik you yoot corpc^iU>coii . Vc /c^k jo'tMU'f (e wk<^^<rt9 M^/h y^^u atiJ 
you« pA4M*pll. 



KiUpk Hotrinfi, ViUttox 

Cajt*i0Kn4A fMACkvot lvAiuAXl<3n i\^ii<:t 



Conmunications with the elementary schools next took place after the CSE 
Survey Kits, containing two of the study's measures, the Attitude to School 
Questionnaire and the Student Productivity Index, had been sent to the schools. 
These communications involved arranging appointments for CSE staff to visit the 
schools and collect the Kits, and obtain attendance and other information. 
After the visits were completed, CSE expressed its gratitude to the 148 sample 
schools by sending each one a complimentary copy of the CSE Elementary Test 
Evaluations. The letter can be found in Figure 12. 
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Figure 12 

rwnk you letter Sent by CSC to U8 S«inple Elewentiry Schools 



UNIVERSITY OF CAUFOANIA. LOS ANGELES 



• •*«« • m u m • um 




Th«nk you varv nuch for helplno us 6bUin the Inforaatlon m iimM 
to covpUtt tht UilfomU Prttcliooi Eva1u«t1on study ir, connoctlon tflth 
AssMbly Bin 451. Our staff art «ost 9rat4fu1 for tht courttout rKeptlon 
extended to than durlns th«1r visit to your school, and^or tht halp thay 
rtcalved to succassfuliy accoapllsh thalr tasks. Ua Muld also Ilka to 
cxprtss a spaclal thank you to tht tMChtrt» aldts and chlldran In your 
school. Our study Muld not hava bttn posslbit without thalr gcntrous 
cooptratiOA. 

As a toktn of our apprtclatlon* m art enclosing a copy of tht 
est tltmmtary Sctiool U9t tiMlmticm. Ut hopt that your school «111 
find tht book ustful . 



Sinctrtly yours. 




Arlant Fink 
Assistant Olrtctor 

California Preschool Evaluation Project 



Enclosure 



Preachool Evaluation Project: 924 WcitwooJ Boulavcrd. Suite 830 
lUlph Hocp(n«r. Dirtctor. ArUn* Fink. Aaaiitant Oirtctor 



The elementary schools that participated in the study also received a 
letter of appreciation from Mr. Post and Mr. Riles. (See Figure 5.) 

Sampling the California Children's Center Children 
California Children's Centers provide day care services with an educational 
component for children of AFDC (Aid to Families with Dependent Children) parents 
in work or training. In this study, children from the pre-school division of 
the Children's Centers were used as a separate group for comparison aqainst the 
State Preschool Program ctvi.dren because the Centers offer the largest single alter- 
native institutionalized pre-school experience for California children. 
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Procedures for Selecting Children's Centers 

The selection of Children's Centers was essentially done in reversed order. 
No attempt was made to obtain a sample that was representative of the statewide 
Children's Center Program. Centers were identified that were likely to have sent 
children to the elementary schools already in the sample. It was assumed that 
these Centers would be geographically close to their respective elementary schools. 

Children's Center selection consisted of three steps: 

1. Identification, by precise location, of each of the 148 sample eleinentary 
schools 

2". ' Determination of Children's Centers- located in tha same city as the • 
schools in the sample and which would, therefore, be likely to have 
sent students to the schools. The Children's Center Directory (Preview 
Edition), published by the State Department of Education in 1973, was 
employed at this step 

3. For large cities, like Sacramento or Stockton, with many Children's 

Centers, a current map of the city was checked to determine which Child- 
ren's Centers are geographically close to the school in the sample. 

One hundred thirty-three Children's Centers were finally identified. No 
Centers were identified for 59 of the sample schools. The Children's Centers for 
each Preschool agency and elementary school in the sample are listed below. 
Rosters from the 47 Children's Centers marked with an asterisk were not received 
because in certain cases. Center personnel indicated that there was too much work 
involved in producing the number of rosters CSE requested or because they had 
lost the rosters. A map of the grographical location of Children's Centers 
clustered by their associated Preschool agencies is given in Figure 13. 
Communications with the Children's Centers 

Once the Children's Centers were identified, a letter was sent to the Di- 
rector asking for rosters of their Preschool children for 1970-1971, 1971-1972, 
and 1972-1973. The letter is reproduced in Figure 14. At the conclusion of this 
evaluation study, the heads of the cooperating Children's Centers received the 
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hmimnmrfTiaaaa 



BEST COPY AVAILABLE 



SWIE PftESCHOOC AGENCIES ANO ElEMCNTAftt SCHOOLS HiTH ASSOClATEO Clll LOAN'S CENTERS 



d/oukl^r A^erwc tl<4cnt4r> 

wa<Js»orth Clc>'<""ary 
1 $tr«tt Clemantar/ 

• J/ > iiv >Citt.r 

• . »tf*? 
•ouO vvnCij^ CiwMhjnfCy 

• • . . I ..ly tjte stnCcf 

• " • t'^hts/ 

"' ftv, 

■^f'■ •»:fc«.t 

• I :ftit.-4.( 

• i.'fij strevt 

Pjr* iilv<f 

• Htvthornte 

• Hi Jv« ;ik«nu« 

• 5jn fvJro ser«t«C 

• Trintiy 

• Vrrfh^n CH>f 

ARVm UMIOH SCHOO L 0 1 STRICT 
$ierr« Vtita Cleawntarr 

.W Children's C«nC«rk Idtnt it imd 

c aigxtC O U'llf lEO SCHOOL DISTRICT 

Oool Cl««tnt«ry 
Hoff<Mn ElMCnt^ry 
Jefferson Ctenentary 
tU*n\ Clea«nt«ry 

to <hi Idran's C«nC«rs tdtitified 



SArtTA C RUZ COHWNITY ACTIOH COUNCIL 

FreeJoMi CieaentAfy 
H4II OiStriCt Clc««nt«ry 
C«^lt CICBcntary 
L^grei Cle«:ent«ry 

fond* 

COHPIO.H UNIFI ED SCHOOL DISTRICT 
J. F K«nne*ly ClcAcnt#r^ 
L^grel Street liVfnft / 
LongfclloM Clte«cntary 
Ar<lelU 8 Iibby Clementjry 

Andttrson 

Caldwell 

tntetptism, tVA 

ire.'iy 

Lincoln 

Kooswolt 

ftos<rcr4ns 

Tibbi/ 

ifillo*fbrook 

• yiiiovitook. tvA 

NEEDLES UNIFIED SCHOOL DISTRICT 

0 Street Elementary 
Gr4c* Henderson EleMnt«r> 
Vl$ta Colorado ElcAant«ry 

Ho Children's C«nt«rs td»n ^ 

VICT OR SCHOOL DISTRICT 

Oct l^ey EleMtntary 
0«}ert Ki^>ll} E)e<*«nt«ry 
Irwin Elt'ntfntAry 
Park Vttw Elementary 

no Chtldt^n'a cwnttffs td^ntiti«d 

PJU.0 VE RDE UNIFIED SCHOOL DISTRICT 

ft\t% J Applebv EleMtntary 
Margaret ^ite Eleowntary 
Kuth trout* Ela««nt4ry 

Ho Children's Cmtmta td^tttified 



Uil all fOiJMiAMuN 

nartin Van b^ren tlet^nt*'/ 
TneoJce koos«^>e*t Elementary 
Pjlm v»e«. £lereit*ry 
valley \it^ Elc^nca^y 

t iCEP riQNfti otji oRj . • 'X ^-'li 

Sjtvrn Street Eter'entary 
5^th Street Eief^entary 
I2^nd Street tlemcntary 

FRESNO CSIF I LP ^C^»OOL DISfRICT 

He«tOn Ele'^entary 
Lane Ele-nentary 
Lin;v>ln Ele^^nt^ry 
Te»lm«n rie<^ntary 

jfvjton 

GOLETA UNION SCHOOL DISTRICT 

Cathedral Oaks Elementary 
El CjM>no Eletientary 
Coleta EleiMntary 
La Patera Elvttentary 

LATIN AHERIC/W CIVIC ASSOCIATION 

Hart Street Elenentary 
O'Htlveny Elementary 
PacolM EleMntary 
San Fernando Elenentary 

* t«My Strwt 

* Hobl* AvtniM 
Hutbtrd Stremt 
PscoimM 

* S*n P''tn*ndo 

Csnogt P*rk 

* Ctlyftrv Care Cencar 

hEHET UWIFTCD school DISTRICT 

Henct Elementary 
Little lake Eleeocntary 
Kaaona Elamntary 
Whiccler Elenentary 

Ho Children'a Canter Identtifd 
COUNTY SUPERINTENDENT Of SCKOOLS-INYO COUNTY 

Lo>lnyo Elementary 
EU Street Elementary 

HO Children' * Ctnfrs Identified 
MODESTO CITY SCHOOLS 



4iuf tir. :ulr.ft f >t i. Ji 
.ri I 

:^n'^ '', .1 • 
* iLnont A/vnui 
I (>>^&tt 
.t.fu'.ufst 
M y *. . n- . t or 

jC ^A;<SI0: UMKt'O SChOyt., Cj STRICT 

O't^ar tienentary 
Laurel £le<rentary 
Li&:<y Ue^nentary 
HtSSton Elementary 

CniUmrt' i CeriCar^ Identitivd 

Oxr<ARD SCHOOLS 

Juanita Elementary 
Kanala Elementary 
H^rtn* We&t Elementary 

iX.»'an MtTirf 
' Avjnur Carw Center 
■ Cjlonia Ojy Care Lantwr 

PAL ERHQ mOH ELEMENTARY SCHOOL UhTRICT 

Eastside Elementary 
Helen H Uilcox Elementary 
Oakdale Heights Elenentary 
Palermo Elementary 

f&ierno School * ' " 

RICHMOND UHIFIED SCHOOL DISTRICT 

Bayvicw Elementary 
Cortez Elementary 
Lincoln Elementary 
Peres Elementary 

Crescent Psrk 

UX» Children'* Cuter 

Mricime Bxtertded Center 

JVjritime Children'* Center 

Peres 

Pullmn 

Apostolic Temple of Truth 
* ConCra Co«Ca Jr. College 
OpporCu/uCy Children's Center 



RIO SCHOOL DISTRICT 

El Kio Elementary 
flio Plaza Elementary 
Kio Keal Elementary 

5ase as Odn*rd Schools 



Falrvlew Elementary 
Robertson Road Elementary 
Shackelford Elementary 
Orville V*i9ht Elementary 

Mod««Co Children' s CanCar 
MONROVIA UNIFIED SCHOOL DISTRICT 

SradoakS Elementary 
HayflOMer Elementary 
Honroe Elementary 
Plymouth Eledientary 

ItQ Chi Idren's Centers Identifntd 

NORTHERN CALIFORNIA CHILD DEVELOPMENT. INC 

CreenvMIe Elementary 
JacVsor He»ght» Elementary 
HCKtnley Elementary 
F'jtcher kaUer Elementary 

Mo Children's Centers tdenHTied 

DAICLAWD UNIFIED SCHOOL DISTRICT 

LoekMOOd Elementary 
Melrose Elertentary 
Ralph J. dunche Elementary 
SconahurSC Elementary 

Horth Permit* Cwmmjnit^ Colleye 

* ieelx *nd am£ 
Brethren Day C*re Center 

* Ca«C 0*XlAr.d Preschool Associttion 

for th^ nenZMlly fettrded 

* Coracca Kir\9 
Presb<jr^ri*n Church 

* St' Andrew's 

St. Vincent's fiay Home 
rayior NcmoriaJ 
mrrf J cc Colie<jo 
ArrOfC Vie;0 
Cltuscn 
Cm I so/< 
Coldvn t>*tt 



ROSLA SCHOOL DISTRICT 

Aerohaven Elementary 
Frultvale Elementary 
Robia Elementary 
Taylor Street Elementary 

* Or^njevile 

* wrfjht 

Associated Student center 
CoJJe9a Town C»mpus 
Cacpus Children's Center 



SACRAMENTO CITY UNIFIES SCHOOL DISTRICT 

Frutt Ridge Elementary 
Jedediah Snith Elementary 
Oak Ridge Elenentary 
Ethel f^hillips Elementary 

CI Dors JO 
C P Huntin<jton 
Elder Creek 
St err* 



SAN BENITO COUNTY Off!CE OF EDUCATION 
Sunnyilope Elementary 

Ho Child*^>\'s Centers Identified 

0IE50 UNIFIED SCHOOL DISTRICT 

Balboa Elementary 
Sandini Elementary 
Crockett Elementary 
Stockton Elementary 

5an Diego Cormunitif College Child 
Development Center 

logsn 
irannody 
ftottsn 



SAH LUIC OBISPO COMNTY OFFICE OF EDOCATIQ. 

Eme'son tlef^entary 
tiargaret H^rloe Etcmentiry 
los Ranches Eleoentary 
.'iipomo Elementary 

So 4/iiiJi«.n's LVnttrk /jt.ttifivi 
SAt t YSIOPQ SCHOOL DISTRICT 

be/cr Elementary 
Snythe Elementary 
Wi I low Elementary 
la Mtrada Elementary 

.vo CM*Jr«n'5 0*nt*r> Idtntified 
C UPERTIN O UNION ELEMENTARY ^ CSfXiL DISTRICT 

Ooyle Elementary 
Garden Gate Eler^ntar/ 

NO Childi^n's Cvntwr* l^*.nX,if^ed 

SANTA MA RIA SChOOL DISTRIC T 

Alvin Avenue Elementary 
Cook Elenentary 
Fairla<«n Elementary 
CalviA C Oakley Elementary 

f,o CiiJJren's cVntwri ld\.ntitied 

SHASTA CClNTr SUPERINTENDENT OF SCHOOL S 
nanzanita Elementary 

Veri-t VjiI* fWiworery . . . 

Keadow Lane Elementary 
Sycamore Elementary 

Anderson Heights 
ke.'idmg Center 

SONOMA COUNTY OFFICE OF EDUC ATION 

Cherry Valley Elementary 
Valley ViSta Elementary 
El VeranG Elementary 
Sassanni Elementary 

(#taJu»j 
Sonoma 

STOCKTON UNIFIED SCHOOL DISTRICT 

Grant Elementary 
King Elenentary 
Tafc Elementary 
Taylor Elementary 

conn ay 

CorctCa King 

ftertm Lxither kinj, jr. 

* rayi&( Ac/'Ooi Agi. <.«.nt<.f 
ven kuien S^t-ool Ag« CcriCti 
Siaria l^ista 

TU LARE COUNTY DEPARTHfNT Of E OUCATION 

Cutler Elementary 
John J. Ooyle Elementary 
Uoodlake Elementary 
Pleasant View Elementary 

NO Children'^ C«n t«is idvnktttvd 

UKlA^t UNIFIED SCHOOL DISTRICT 

Calpella Elementary 
Frank 2eek Elementary 
Oak Manor Elcmentarv 
Yokayo Elementary 
Redwood Valley Elementary 

VkiAh Vslleg cm id Urn. iuptrvnt v-entvr 

VENTURA COUNTY CGWUNI TY ACTIOfl C^^KIiSS lOH 

Ramona Elementary 
Pierpont Elementary 
E.P Foster Elementary 
Park View Elementary 

Same as Otmrd Schc*j:, 

VILLA ESPERAN^A 

Haffl<lton Primary 
Jefferson Primary 
Roosevelt Elementary 

Car/ield 
Hodges Center 
■ Jeffet>on 

* Long/allow 

* Hddison 
Veshington 
wilUrd 



WEAVER P RESCHOOL 
Weaver EleMntary 

SAN LORENZO VALLEY UNIFIED SCHOOL DI STRICT * >/»e«fty >c/.oo] 

YUBA CITY W<IFIEO SCHOOL DISTRICT 



fiogldcr Crfek Elenentary 
Quail Hollow Elementary 
San Lorenso Elementary 

NO Children's Centers tdentHiad 



Oridgc Street Elementary 
Paik Avenue Elementary 
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Figure 13 

Hdp of GMSriphtct) locjtion of 133 S»«p1t Cnlldrtn'S C«i>t«r» 
Clusttrid by Ihttr Asiocttted Prtiehool A9«ney 




same letter of appreciation from Mr. Post and Mr. Riles as was sent to the 
Preschool agencies and elementary schools in the sample. (See Figure 5.) 

Sampling the Children with No Traceable Institutionalized 
Pre-School Program Experience 

In California, children are required by law to start school at the age of 
six. Before that time, if they are eligible, they may attend State Preschool s. 
Children's Centers, Head Start Centers, Migrant Preschool s, the Educationally 
Disadvantaged Youth Program preschool s, and Title I preschool s. Other alter- 
natives for children under the age of six include attending a privately run 
pre-school or remaining at home. 

Records of children's pre-school experiences are not kept in a systematic 
way by elementary schools. Some schools have traced these experiences for 

- 34 - 



ERIC 



00 044 



letter to Children's Center Director Requesting Rosters 



UNIVERSITY OF CAUFORNIA. LOS ANCEUIS 




CKHTCft ro* TMC ftVDV or k\4llr« 
bCVACAAOVATk KMOOl Of ^Ml *TM 



The Office of the Le^lsletlve Anelyst has contracted with us to 
conduct e study of Ce11fomla*$ sUte preschool progrins In eccordince 
Mith AS 451. To do this, we et the Center for the Study of Eveluetlon, 
In cooperitlon with the SUte Ocpirtment of Education, ire Investigating 
the conparatlve 'productivity, perfomance and mtlvatlon'* of children 
currently In klndergerten, the first or second 9rade In selected eleMiitary 
schools throughout the state of California. Sone of these children have 
recelve<) care In a SUU Preschool, sone were cared for In a Children's 
Center, while others did not receive care In either program. So far, the 
Center has sai^iled and Identified children who have had SUte Preschool 
care. Ue now need your help In Identifying children who have etteoded 
ChSli-sn't Csnte'i »r» thcr«fore reouei^tlnq. that you send us rosters 
of the children In your prograai for the three years: 

1970- 1971 

1971- 1972 

1972- 1973 

If your Center was not funded for ell three years, please send us 
rosters for each year that you were fugdcd. The rosters should t>e se^t to: 

Or. Arlene Fink, Assistant Director 
California Preschool Evaluation Project 
CenUr for the Stu^y of Eveluatfon 
924 Uestwood Blvd., Suite 600 
Los Angeles, California 90024 

Ue are aost greUful for your assistance, and appreciate your prompt 
attention to our request. If you have any questions, please feel free to 
cell us tt 213-825-4711. 

Sincerely yours,, 

Arlene Fink, Assistant Director 
California Preschool Evaluation Project 



Prstchool Evaliutton Proleci. 924 Wrttwoud Boulevard Su4U »<)0 
iUlph Hoepfner. Director, Arlene Fink, Ati4ttant Director 



several children; others have not. To locate children who had attended State 
Preschool s and Children's Centers, CSE had to rely upon rosters provided by the 
agencies administering those programs. No similar rosters were available for 
the rest of the children in the sample elementary schools. Unless CSE had 
used the expensive and time-consuming process of interviewing the children's 
parents, it would not have been possible to identify the precise nature of their 
pre-school experiences. Further, no other single program, except the Children's 
Centers, is monitored to constitute a major alternative to the State Preschool 
Program. Therefore, in the absence of concrete information about the many 
available pre-school experiences, the third group of children in this 



35 



evaluative study was considered to have experienced "No Traceable Institutionalized 
Pre-school Program," or "No-Program." They were selected at random from the 
elementary school children who had not been enrolled in the State Preschool Program 
or the Children's Centers. It is possible that some of those children had 
actually experienced one of the pre-school programs. 

Preschool rosters requested from the Victor School District and San Ysidro 
School District were incomplete, which may have resulted in the incorrect assign- 
ment of some children to the "No-Program" group. However, the number of children 
incorrectly assigned was considered too small to have significantly affected the 
study's findings. 

The Final Samples of Children 

Evaluative information was obtained from the schools for a total of 35»286 
children, 11,532 at the kindergarten level, 12,193 at grade one, and 11,561 
at grade two. These students were then classified into the three groups that 
constituted the primary evaluation design: State Preschool children. Children's 
Center children, and No-Program children. Classification of children into the 
first two groups was achieved by matching names of children on State Preschool and 
on Children's Center classroom rosters with the names listed on the classroom 
rosters of the schools expected to have received them. Children in the third 
group were randomly selected from among the remaining elementary school children 
within the same classroom. 

The number of State Preschool children with evaluative information in each 
classroom determined the maximum number to be drawn for each of the three 
evaluation groups from each classroom. If no State Preschool children were in 
the classroom, then none of the students from that classroom were selected. If, 
for example, there were four State Preschool children in the classroom, then no 
more than four children with each of the other pre-school experiences were also 
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selected from the classroom. If four of one of the other groups could not 
be found in the classroom, then the needed number was not obtained from 
any other classroom or school* This restrictive sampling approach was adopted 
to avoid perpetuating potential inequalities among the three groups of 
children being compared that have been known to result from ability tracking 
and incomplete school integration. The specific sampling procedure is described 
as follows; 

CImroQii S«i9l1fl9 Procfdurts 

Cvtry child with onf or nort oltcn of tv«lM«t1vf InfonMtlon It fllglbU for b«lA9 
• ' " *" ''snipled trm tht cU$<roo«. Tht Priscnool 3r«4Mffs trf t>it simpU of rtjor coftc«fn, and ' - • 

thtrcfort thfy'sit tht saNp1lA9 proctdurt. 

First* tht Prtschool chndrtn are Identified. Let P eguil the niiiter of Preschool 
children with et leest one piece of eveluetlve infonwtlofi Identified within eech 
clessrooM. 

Second) Identify the Children's Center children who heve et least one piece of evelu* 
etive infometlon. Let the nunOcr of such children be C* Select t*>cse children so 
that C Is equal to or less than P within each classrooM. 

Last, randomly select a number K of No*Pro9raii children who have at least one piece 
of evaluative Infonwtlon. N should be equal to or less than P (It «ay be equal to, 
less than, or qrtater than C). 

tegardless of the Inequality of the saf^le sizes within a classroom, there should be no 
extra-classrocR saaplinq In an effort to equalize the ntpbers. It mIII always be the 
case that all the Preschool children will be selected, and there will be no other sample 
with More cKTldren than the Preschool saaple, either within a classroom or in the total 
study. 

Because 51 of the sample schools had no geographically close Children's 
Centers, the number of children having experienced the Children's Center 
program was expected to be smaller than the other two samples. This dif- 
ference caused minor complications in the analyses to be reported, and is 
reflected in Table 4 below, which describes the final number of children 
who participated in this evaluative study. 



T«b1e 4 

IlunOer of CMldren In E«ch Eviluatlon Group to the FlMl Swple 



Grade 


State Preschool 
Children 


Children's Center 
Children 


Children with No 
Traceable !nsti* 
tutlonallzed Pre- 
school Program 
(No-Program) 


Kindergirttn 


1,160 


146 


1*148 


Grade 1 


977 


94 


974 


Grade 2 


714 


66 


712 
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THE MEASURES EMPLOYED 



The evaluative study required by AB 451 was to include "to the extent pos- 
sible, a retrospective analysis of improved and sustained performance, -motiva- 
tion, and productivity achieved in the early elementary years It was necessary, 
therefore, to select measuring instruments and procedures that would focus on 
those characteristics and that would be appropriate for children currently in 
kindergarten, the first, and second grades. In addition, measures were needed 
for Preschool purpose and elementary school enrichment. 

Measures of Student Characteristics 
* •« . .. ....... . , 

Measures of the student characteristics were selected to meet three crit- 
ical criteria: 

Validity - The wording of the legislation was rephrased into what educators 
call "objectives," and measures were then selected that were 
closely targeted to the objectives. 
Reliability - Measures were selected that had previously been employed with 
similar children and had proved to provide stable and well- 
graded scores. 

Appropriateness - Measures were selected that were appropriate for young 
children; that would not bore or tire them, or unduly 
challenge them. Whenever possible, CSE chose scores that 
were already on students' records in order to minimize 
the amount of testing each student would have to endure. 

Measures of Performance 

The AB 451 term "performance" was rephrased to mean "academic performance" 
to conform to the educational objective implicit in the original Preschool legis- 
lation (AB 1331, 1965). There is general agreement among educators that academic 
performance is at present most effectively assessed with achievement tests. 
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Therefore, student scores on two achievement tests used in the 1973 Statewide 
Testing Program were employed: the Entry Level Test for first-grade students 
and the Cooperative Primary Test - Reading for second-grade students. By relying 
on information already on the students' records, the amount of time required 
for testing and interrupting normal classroom routine was minimized. 

The Entry Level Test . In the Fall of 1973, every first-grade student in the 
State was to have been administered the Entry Level Test . This test was devel- 
oped by the California State Department of Education to obtain baseline information 
on students and on schools. It is optically scored by computer and has subtests 
for Immediate Recall, Letter Recognition, Auditory Discrimination, Visual Dis- 
crimination, and Language Development. Scores on the subtests are summed to 
provide a total raw score. The five achievement areas thus assessed are commonly 
included in tests of reading readiness. Because scores are not reported by 
student name, characteristics of each child in the three samples were matched 
with those on computer print-outs provided by Westinghouse Learning Corporation. 

In correspondence- with Dr. Lorrie Sheppard, who was responsible for the 
test's development, CSE obtained the following psychometric information on the 
Entry Level Test . 

Validity - Items were reviewed and edited by several persons; intercorrela- 
tions with other standardized tests ( Metropolitan Readiness Test , 
Metropolitan Achievement Test , and Clvmer-Barret Reading Test ) 
were moderate. 

Reliability - test-retest reliability of individual scores was computed to 
be .62. 

Appropriateness - items were designed to be relatively easy and proved to be 
so. Using school mean scores, high-moderate correlations 
were found with percentage of English-speaking children in 
the school and with percentage of white children. 
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The Cooperative Primary Test ■ Reading. Every first-grade^ student In the 
Spring of 1973 (second graders at the time of this evaluation) was to have been 
administered the Cooperative Primary Test - Readings. Form 12B > published by 
Educational Testing Service, 1965. The test was developed by an advisory panel 
and by educators. Students must read the words, sentences, and paragraphs to per- 
form on this test. The vocabulary level was carefully controlled to be at a stan- 
dard primary level, but was not tied to any particular test or reading program. 
School and district records for the Cooperative Primary Test - Reading were 
. maintained in various formats: naw.scares. Percentiles, stanines.,. arjd grade equi- . 
valents. For purposes of data analysis, all scores were kept as raw scores or were 
converted back to raw scores via the published norm tables. Where scores were 
based upon local norms, the local conversion tables were used to un -convert the 
scores. 

The manual for this test classifies the items into categories of Comprehen- 
sion (identifying an illustrative instance and identifying an associated object or 
instance); Extraction; Interpretation, Evaluation, and Inference. 

Validity - items professionally developed and edited; no other-test inter- 
correlations reported. 

Reliability - alternate-form and internal-consistency 

reliability coefficients range from the high .80s into the .90s. 

Appropriateness - items exhibit a wide range of difficulty levels. 
Measures of Motivation 

AB 451 was not specific with regard to aspects of motivation that were to be 
considered in the evaluation. Once again, CSE elected to interpret the word in 
terms of academic achievement in accordance with the objectives planned for the 
Preschool Program (AB 1331, 1965). Psychologists of personality (e.g., Cattell, 
1957; Guilford, 1959) contend that attitudes are clear and observable manifestations 
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of internal and unobservable motivations. An individual's attitude toward a 
thing or activity is a measure of the direction and intensity of the motivation 
for it. Ball (1971) found evidence of a crystallized attitude toward school by 
age 5 or 6, and Hartvill (1971) found that children are willing and able to attend 
to tasks involved in picture-based attitude scales. 

The Attitude to School Questionnaire . CSE selected its own Attitude to School 
Questionnai re (Strickland, 1970) as the primary measure of motivation as reflected 
through attitude. The Questionnaire is a group-administered measure of academic 
sentiment, containing fifteen scored picture items presented one per page in two 
forms: a girl's form featuring pictures with a girl as the main character and 
a boy's form featuring pictures of a boy. The students were given oral descrip- 
tions of various school -related activities, about which they recorded their 
attitudes by circling a drawing of a happy, neutral, or sad face. The Question- 
naire avoids dependence on children's reading skills; no reading is required. 
The vocabulary used in the oral story narrations were checked against the 
Rinsland (1945) and Thorndike (1921) lists and was found to be suitable. The 
pages of the Questionnaire are colored rather than numbered so the child needs 
only to know the colors white, pink, blue, yellow, and green. 

Figure 15 illustrates an item taken from a sample page of both the girl's 
and boy's forms, with the oral text in both English and Spanish. (The written 
text is heard by the examinee; it is not read.) 

In creating the illustrations for the Questionnaire, great artistic care was 
taken to make the people in the figures free of racial characteristics so that 
children of the various racial groups would be equally likely to identify with the 
appropriate one of the three faces. 

The Attitude to School Questionnaire was administered to all kindergarten, 
first and second-grade children in the evaluative study by their classroom 

- 41 - 



00051 



ngurt IS 

U«4 froM toy*! AM Q\rV\ Fon« of thf AUtty<t to Sclwol QMttt<o«w«<r» 




teachers* Reported administration difficulties were routine and in no way 
exceptional* The scoring of the Questionnaire was done by hand. Each happy 
face marked was scored tv/o points, a neutral face earned one point, and an un- 
happy face received no points. Items to which there was no response were scored 
one point. Scoring was discontinued for any student's booklet that contained 
three or more consecutive omissions. Raw scores were employed in all analyses. 
Validity - Items of the Questionnaire were developed to survey atti- 
tudes to school, show-and-tell activities, school-work, math, 
reading, non-threatening authorities, authority in general, 
and peers and play. Factor analyses confirmed the existence 
of several of the factors. 
Reliability - Internal consistency reliability coefficients had been 
estimated' in the low nineties, but the test-retest reli- 
ability, estimated over nine months, was only .13. The 
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fifteen-item internal -consistency reliability ( alpha ) com- 
puted from children participating In the present evaluation 
is reported In Table 5. 



liiltml-Cofltittcncr RclttbtlUr tttlMIn ( MpM ) 
of «ltltuilc to SciiMl QtKttlomiIra 



Cr*de tcvei 


%Mbtr of ChOdrtn Tested 




Ktnderqjrun 




.91 


rirtt Cr4it 






Wcof d Cr«de 


10,229 


.76 



Attendance Records . In order to avoid additional testing that might over- 
tax both sciiool .persoonel and the students and to provide additipnal knowledge 
about motivation, attendance records were used as an unobtrusive measure of 
student Interest in school.. Although absenteeism has not been widely used in 
large-scale evaluation studies as a reflection of student interest in school, 
support for this measure was found in reports that reviewed much of the research 
on assessing young children (Ball, 1971). In a report dealing with behavioral 
objectives in the area of attitude toward school, the Instructional Objectives 
Exchange (1970) suggests attendance records as a measure in the intermediate 
and secondary grades. An unpublished evaluation report of the Los Angeles Uni- 
fied School District shows consistently lower absenteeism figures for children 
who had pre-kindergarten experiences. These differences are maintained longi- 
tudinally through the third grade. 

All records of numbers of days absent at each school were converted into 
percentages, based upon the number of days of school during the Fall, 1973, 
semester at that school. In this way, attendance records from different schools 
with different schedules were converted to a common base for analysis purposes. 
Measures of Productivity 

The concept of productivity in education suggests the creation of numerous 
educationally valuable products l^ke completed homework assignments, essays, 
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projects, and even poems or scientific experiments. In analyzing improved and sus- 
tained productivity in young children, however, it did not seem suitable to count 
the number of such products created, or to appraise their .*elative values (or their 
values to their relatives). Further, an extensive review of the educational and 
psychological research revealed that "productivity" has seldom been studied, but 
that when it has been investigated, it has usually been defined in terms of task 
orientation. 

The Student Productivity Index. Since the ability to attend to a task and 
follow it through to completion may be considered -to be. a logical and necessary 
first step in the production of educationally valuable products, this evaluative 
study employed a measure of task orientation as a major dimension of productivity. 
Thus, the Student Productivity Index (see Figure 16) was adapted from the Class- 
room Behavior Inventory (Schaefer, 1971) for this study. The adapted version is 
nearly identical to the original, with the exception that minor changes in the 
wording were made mainly to eliminate possible sex bias. e.g.. "he/she" replaced 
"he" in two items. 

The Student Productivity Index was used by a teacher to rate his/her students 
on a seven-point scale from "always" to "never" for five items dealing with dif- 
ferent aspects of task-orientation behavior in the classroom. The instrument usual- 
ly required less- than two minutes to complete for each child, and assumed that 
teachers could make fairly reliable judgments about specific classroom task-oriented 
behaviors. 

Each teacher rated each child in his or her class on five task orientation 
items, using the seven-point scale. For the teacher's convenience. CSE had placed 
the students' names on the Index in advance, relying on the classroom rosters 
previously sent by the elementary schools. Scoring was done by hand and involved 
computing a total score for each student by adding the teacher's ratings. If 
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Figure 16 
Tlie Student ProctuctivUy Index 



STUDENT PRODUCTIVITY INDEX 
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the teacher's ratings for a student on one or two items were missing, a median 
score of four was assigned for that item. If more than two ratings were missing 
for any one student, the student's score was not recorded. 

Because research has consistently shown that different teachers use different 
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standards in making their rating:? of students, the ratings for each classroom 
teacher were standardized into percentiles to obtain a common base for analysis 
purposes. In this manner, both "easy ^i.teachjr/rdters and "hard" ones could 
be generally equated and only differences among the students would remain for 
evaluation purposes. 

Validity - The Classroom Behavior Inventory was developed from factor- 
analytic techniques (Schaefer, 1971). It was employed in 
the Head Start Planned Variation evaluation for 1971, and 
was found to correlate .40 with the total score of the Tests— 
of Basic Language Competency in English and Spanish, Level 
1 (Preschool) (Cervenka, 1968). 
Reliability - Test-retest reliability coefficients, based upon the Head 
Start sample, were in the .70s. Inter-rater reliability 
coefficients were in the low .60s. The Task Orientation 
scale's internal-consistency reliability coefficient was .72. 
Summary of Measures of Students 

Table 6 shows the measures of performance, motivation, and productivity 
that were obtained for kindergarten, first, and second grades. 



T«b1e 6 

S»^mtrf T«b1e of SCudenc Measures by Sr«de leveU 



Gride Perfonunce 


MociviCicn 


rroducCt/Uy 


K 


AcciCude CO Schdol 
Questionnjfre 

AcCemUnce k»tt 


Student ProducCivity 
Index 


1 

Intff Level TesC 


AccUude CO ^hool 
QuesCionn^fre 

Actef)d4nce R<Ce 


SCudenC Prodacclvic/ 
Index 


^ Coopef«Cfve 

CrfAjry Test - 
Rtfidino 


ActiCude CO School 
Quest <oiM<{fe 

Actend^nce RJCe 


StudenC ProducCiv^Cr 
Index 



The CSE Survey Kit . To facilitate the administration and use of the 
Attitude to School Questionnaire and the Student Productivity Index , both 
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instruments and the manual for the Questionnaire were placed in an illustrated 
box called the CSE Survey Kit, which is reproduced below in Figure 17. 



CSE Suner Kit 




The Kit contained a sufficient supply of materials and had the teacher's name 
and the class on the box cover. It was accompanied by a letter to the princi- 
pal and instructions for the teacher. The letter to the principal is reprinted 
in Figure 18. 



Each principal was allowed at least two weeks to distribute the Kits 
and see to its completion by the classroom teachers. The teachers' instruc 
tions are given in Figure 19. 
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Figurt 18 

Ittttr to Principal CoACtmln^ CSC Survfy Kit 



UNIVERSmr OF CALIFORNIA. LOS ANGELES 




cttrm poa ym miav or ivalvatiom 



Thank you for stndino us tht cUssrooa reglsttrs for your school. On 
the basis of th«a, tht California Prtschool Evaluation ProJtct Is tnclosing 
ont CSE Survey Kit for each kindergarten, first and second 9rade citssrooa 
In your school. The teachers* nmtt and classes, found on tht top right- 
hand comer of each box, are provided to east distribution of tht Kit. 

Each CSC Survey Kit conUlns three coapenents: copies of the Attitude 
to School Questionnaire, a Teacher's Manual for adninlsterlng the 
Questionnaire, and a Student Productivity Index. There are enough copies 
of the Questlonralre for each child In a teacher's class uid one Student 
Productivity Index for each class. The Questionnaire and the Index take 
approxinately tMcnty MinuUs apiece to co«p1eU. Ut would apprtclaU your 
giving the Kits to the teachers as soon as possible so that you can collect 
thOM by 

ue are asking that all conpleted and unused Questionnaires and Ir.dexes 
be returned to us In their original boxes. Our staff will soon be contact* 
Ing you to nake arranganents for us to pick up and score the conpleted kits. 

Thank you very wch for your assistance. 

Sincerely yours. 



Ralph Hoepfner, Cn rector 

Arlene Fink, Assistant Director 
ailfomla Preschool Evaluation Project 



Enclosure 



Measures of Preschool Agencies 

Preschool Agency Purpose 

This evaluation study did not focus on the specific purposes of each Cali- 
fornia State Preschool, but concentrated instead on the question of the effec- 
tiveness of the State Preschool Program as a whole. Nevertheless, data were 
collected to provide descriptions of the general purposes of each Program during 
the three years of interest. The Preschool purposes, as reported by the Pre- 
school agency administrators, were then compared to the enabling legislation 
to provide a check on how well the legislative mandates were being met. More 
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Ffgurt 19 

Tetchers' Instructions for Using CSC Survty Kit 



UNIVERSITY OK CAUtOKNlA. LOS ANGEL KS 




MNTA tAMUM • MST4 CMI 



rii«TKii row Tlit n\U\ or fcs4iV4TiuM 

lOkAli»CfcUfl.LAUtMI\l« t(Wl4 



THE CSE SURVEY KIT 



Th* C<^.:cnta <yf this X:i 



Twenty blue copies of the Attjtudc to School Qots t 1 oon«1 re 
Twenty pink copies of the Attitude to School qucstlonn«i7c 



Direct icKS for L'ting this f.ic 

The Attitude to School Questionnaire 

iiOi ditld in your cUss should fUl out • Questionnaire. 
Complete instructions for adninistrUion are given In the 
Teacher's ttanual . Please read the Manual at least once 
t»etore adainis:erii>9 the Questionnaire to your class. 
There is no need for you to attenpt to do any scoring. 

Ihe Student Productivity Index 

Please rate each child on each of the five Iteas directly 
on the Index forw- 



You Should arrange to adramister the Atti tutle to Stfiool Qucs tionnal re 
(about 20 ntnutes) «nd to conplete the Student Productivity index during 
the week of 

After the Questiconaire and the Index have been completed* please 
out thecj, with the Manual and any unused copies. In their original box, 
and return the entire Kit to the Principal. 

ThanK you very rauch tor your help y a 

Ralph itoepfner. Director 

Arlenc Fink, Assistant Director 
California Preschool Evaluation 
Project 



important, however, data on the purpose of each agency provided information for 
comparing types of agencies in terms of their differential effects oh students. 

The Preschool Agency Purpose Survey. The administrator in charge of each 
of the Preschool agenices involved in this evaluative study participated in 
the Survey. There were three parallel forms of the Survey, one for each of 
the three years, 1970-71, 1971-72, and 1972-73. Agency administrators were 
asked to rank-order five possible preschool purposes. The Survey form for the 
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year 1971-72 is reproduced in Figure 20. Each Survey was printed on a CSE 
self-addressed postpaid postcard for convenience. 

FlQurt 20 
htschool AffMcy Purpost Survey 

l^e list telow contdifi ftvfe purposes of preschool education. P1e«M rank these pur* 
Wif:% according tc hov much enphasis e«ch received In your Sutt Preschool Progrto dur- 
rn^j the 1S72.19?3 school ye<r. The purpo>e th*t Is e«ph4Slied MSt should be r*nked 
"I", tne second oost wphasUea should be ranked '2.'- etc. Bt surt to wrIU In • rink 

for (racn purpose. 



PRESCHOOL PURPOSE 


RANK 


help children inproye tr.eir visual and hear1n9 sensitivity: to fac111t4te 

mizU develo;^ent *ni coordination. 




lo help Children develop skills fn comunlcation verbally and orally; to pro- 
file ability to deal with concepts Such as nuttbtr, tine, color and sUe. 




lo help Children becone considerate of others, cooperative and friendly; to 
help thep t<ant to share, and to respect public and private property. 




lo help children acquire a favorable attitude toicard attending school, their 
teachers and learning; to help promote an appreciation of persistence and 
AChlevenent. 




To help Children develop a healthy self-concept, self-estte«, and self-confi- 
dence; to develop a sense of personal Morth, stlf^undersunding and stcurlty. 





Thank you very auch for your cooperation* 



The five purposes each Preschool administrator ranked were selected to 
cover the wide range of objectives and purposes that are the current targets 
of pre-school education. Although five-category descriptions can hardly be 
expected to encompass the scope of any educational program, the Preschool admin- 
istrators did not appear to have difficulties in describing their individual 
programs in terms of the five rankings. 

The means of the ranks provided by the Preschool administrators for all 
42 agencies and over all three years are presented in Table 7. 



Table 7 

Obtained Mea.i R«nks of the Five Preschool Purposes 



Preschool Purpose 


Mean Rank 


PsychoHiOtor Oevtlopoient 
Prtacade«ic Skills 


3.? 


2.< 


Soclallxatton and Interaction Skills 


3.8 


Attitude to School and Icamino 


3.3 


Self-concept Oe/elopieent 


1.4 • 



The purpose most frequently ranked as being most emphasized is that of 
development of students' self-concepts, while the second ranked purpose is that 
of Preacademic Skills. The enabling legislation, on the other hand, has not 
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specified improved self-concept as a Preschool objective (partly because the so- 
cietal value of its achievement is only speculation, and partly because there is 
currently no exportable intervention program that directly addresses, it in a con- 
vincing manner), but has placed emphasis upon the preacademic educative function. 
It would appear that the majority of the Preschool agencies have kept the legi- 
slated mandate clearly in mind, while replacing it with another, less accountable, 
and more nebulous one. 

The original intention of collecting the data on Preschool purposes was, how- 
ever, to enable comparisons among types of agencies in terms of their effective- 
ness. This was planned to meet the contingency that the primary evaluation find- 
ings might be ambiguous. The 42 agencies therefore had to be grouped into clusters, 
based upon similarities of their purposes. Because 98 percent of the agencies 
had ranked the self-concept purpose first or second in importance, no discrimina- 
tions among the agencies could be made on the rankings of that purpose. Agencies 
were grouped together that ranked other purposes highly. This technique was 
successful in grouping all 42 agencies into three types. Twenty agencies belonged 
to the type that emphasized Preacademic Skills. Eleven agencies belonged to the 
type that emphasized Socialization and Interaction Skills, and 11 belonged to the 
type that emphasized Attitudes to School and Learning. 

For the comparative analysis, each agency was therefore coded as belonging . 
to one of the above three pre-school types. No attention was paid to elementary 
school purposes, and how they might interact with pre-school purposes. 

Measures of Continuing Educational Enrichment 

Many individuals who are concerned with the education of young children 
(Jensen, 1967; Deutsch, 1969; Silberman, 1970) have theorized that the ultimate 
success of pre-school experiences is dep^pdent upon the richness and quality of 
subsequent elementary education. Bettye ^aldwell (1968), for example, has stated 
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that "it seems imperative to link preschool programs with elementary education 
programs." 

Based on this position, CSE collected data on the enrichment provided by 
each elementary school in the evaluative study, so that pre-school effects could 
be considered with respect to variations in the quality of elementary education.. 

The Enrichment Checklist. A child's experiences in elementary school can 
be improved in quality and enriched in many ways: through competent and under- 
standing teachers and administrators, the use of appropriate curriculum materials, 
and educationally sound activities, to name but a few. Although money alone does 
not guarantee an enriched educational experience, CSE employed funded programs 
as the measure of the degree of enrichment in continuing education. For the 
purposes of this study, enrichment was thus gauged by the number of non-locally 
funded (state or federal) educational programs operating in the school. Because 
exact dollar amounts, and enrichment effects, were difficult to determine and 
evaluate, CSE used only the number of such programs installed as its measure of 
enrichment. 

A checklist was, therefore, completed for each school in order to tabulate 
the number of non-locally funded programs. In an attempt to simplify the check- 
list, and to make it nearly comprehensive, the following program types were listed: 

State Early Childhood Education Program 

Follow-Through Program 

Miller-Unruh Program 

Right-to-Read Program 

State Bilingual Program 

State Mentally Gifted Minors Program 

Title I (Disadvantaged) Program 

Title III (Innovative) Program 

Title VII (Bilingual) Program 

Other Programs 

At each school, the operating programs were checked and the number of checks 
was later tabulated as the enrichment index. The 148 elementary school enrichment 
indexes ranged from 0 to 7, (that is, no school was enriched by more than seven 
programs), and were distributed as described in Table 8. In order to create two 
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discrete categories of approximately equal numbers of schools, the index was 
dichotomized at 2,5, near its median value, and all schools with 0 to 2 enrich- 
ment programs were classified as "Low Enrichment,'^ while those with 3 or more 
enrichment programs were classified as "High Enrichment." Eighty schools were 
classified as "Low Enrichment" in this manner, and 68 were classified as "High 
Enrichment." If the state's Early Childhood Education Program is. not considered 
as providing enrichment that could affect the evaluation data (due to its recent 
innauguration), the index value for separating high from low achievement schools 
would remain the same, but the categories would contain very unequal numbers of 
schools with 18 moving from the high group to the low group. The state's Early 
Childhood Education Program was therefore included in the index as an "adjust- 
ment" to obtain a more equal dichotomization. 



Table 8 

Nu«ber of Schools ReceWin9 Each Enrlchnent Index 



Enrlctnent Index 


NuKber of Schools 


Enrichment CUssif icatfon 


0 


22 


"Low Enrtch»ent" 


1 


18 


(80) 


2 


40 , 




3 


38 




4 




"High Enr1chiri«nt" 


5 


1 


(68) 


6 


2 




7 


2 




8 


0 




9 


0 




10 


0 




Total 


148 


« 



The Collection of Information about Performance, 
Motivation, and Productivity 
As a result of the sampling procedures, 148 elementary schools throughout 
California were selected for the study. Information about the comparative per- 
formance, motivation, and productivity of the children in these schools was 
obtained by relying on their records of achievement and attendance and by using 
the two specially prepared instruments, the Attitude to School Questionnaire 
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and the Student Productivity Index. On the basis of rosters for each kinder- 
garten, first- and second-grade class sent by all elementary school principals, 
CSE Survey Kits containing these instruments were sent out for completion. 

To maximize efficiency, CSE arranged to send its own field evaluation per- 
sonnel to each school to collect the Kits and to transcribe the school record 
information. In this way, CSE believed, the need for school staff's time and 
involvement would be minimized and information would be gathered in a uniform 
and reliable manner, thus making it ultimately easier for CSE to organize the 
information for analysis and interpretation. Field evaluators were therefore 
recruited and trained. The schools they visited were arranged into itineraries 
of three, four, or five schools each according to geographic location and prox- 
imity. For example, there were three schools in Santa Maria, four in Pasadena, 
and five in Stockton/Modesto. There were approximately seven itineraries in any 
one week, and eight weeks were allotted for school visitations by the CSE field 
evaluators. 

Recruiting and Training Field Evaluators 

Preference for the job of field evaluator was given to individuals: 

With current and valid California driver's license 

With at least a BA or BS degree 

With credits in education, psychology, sociology, or 

public welfare 
With experience in the public school system 
With sound and practical judgment 
With interpersonal skills 
Who could and would follow directions 
Who would dress and comport themselves in a way consistent 

with the expectations of regular school personnel 
Who would work typical school hours (work beginning at or 

before 8:00 a.m.). 

Once. the field evaluators were selected, they were formally trained by regular 
CSE staff in group and individual workshop sessions to perform their responsi- 
bilities. To facilitate training, each field evaluator was provided with a copy 
of a "Procedures for Visiting Schools" booklet, which explained the purposes 
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and procedures of the evaluative study, gave a detailed description of the 
evaluator's responsibilities, and provided him/her with samples and extra copies 
of all information recording forms. 

Explaining purposes . This section of the ^'Procedures for Visiting Schools" 
booklet was intended to give the field evaluators a capsule summary of the 
Preschool Evaluation Project and the Preschool Program and also to provide a 
sense of the sequence of events so that they would be able to establish a sense 
of the context in which their responsibilities were to be fulfilled. The 
"Introduction" to the study, written for the field evaluators, took the 
form given in Figure 21, 

Fl9urt 21 

lfitrodi.ctlon to tht UllfomU frtichool C«lMtlo« frojttt (CfCf) 



1. Introduction to ih« 
•aalFORHU fCSCMCOt. tVALUATION P»aECT (CPEP) 



Tht Cwttr for tht Study of Cviluttion «t UCU ^'«^ «>«7 , 
the Office of th« L«9ltUt1ve An*lytt to conduct tn evtluitlon tt«dy of 
UllforflU'i SUU Prttchooli. Tht Pretchool Proflrw «t cmttd by 
Aslwbly Sin 1331. Tht CtnUr't Evtlu«tion Study Ml wndittd by Ass**^/ 
lt>l 4&1. This Sill s«yi: 

This study shtn -include. . .*n tv«lu*t1on of. tht rtsults «ch1tvtd 
by tht prmhool Qroqrm through i control ltd tvtluttlcs of perticl* 
P«t1ng chlldrtn. This tv«luit1on shoulu Inclwdt, to th* txttn> 
posslblt, « rttrosptctlvt «ntly$1s of (Pcrovtd tnd sustained mii" 
v«t1on, ptrfonanct, «<»d productivity ic*;1tvtd In klndtrgirteo 
through gr^dt [2]. (Stctlon 6) 

To fulfill tht rt<ju1rt«^ts of tht 8111. CSE his ^"•lop*^,"^*''**;* , 
SMpllng proctdMrts to Mkt surt thit Inforwtlon <s colltcttd «fP'^<»pr^ 
tut tiSuryichools on «s Mny fomer preschoo* ihlldrtn «s P0"»»»«« «d 
thIt thtlnfofMtlon Is iccu/itt In Utm% of tht W^grni's geogrtphlc. rwUl 
ind teoIloiri^Sulrlitilts. Tht tle<itnUry schools (or districts) thtl you 
trt visiting mm stltcttd ts « rtsult of the sibling proctdures. 

The prlndptl of tht tltuwnttry school ind the superintendent of the 
school district In »(h1ch tht schools trt locittd hivt bttn InfarAtd lh J 
Ittttr s gntd by Dr/U11so« ftllts thd Mr. A. Alin Post of tht purposts of 
tht eviluitlon study, tnd the InfonMtJon CSE needs AS you cjn stOj CSt 
Is working with tht SUtt Dep*rti»nt of Educitlon iS Mtll « tht t«»i«JJJ 



letivt 




htvr bttn provided 



Your J^jor rtsponslbllltlts for tht Cillfoml* Prtschool Pfojtci ere 
to visit scSols to collect end i«turn to UCU the coi»>leted "E Survey Kits 
Md to record infonution on tht School RKord ftosttrs. Tou will also be 
SpacJeTtSloililetrthrSchool tiperience ^om. end to keep records of your 
tint ind txptfists. 



Detailing responsibilities ^ Field evaluators had three basic responsibili- 
ties to the study: to visit the sample elementary schools; to collect the 
completed CSE Survey Kits; and to transcribe information from school records 
onto CSE forms. Evaluators were also required to keep accurate records of 
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their time and expenses • 

Visiting the Sample Elementary Schools 

A "School Folders Packet" was prepared for each itinerary. In this packet, 
the field evaluator was provided with a map of the area to be visited; self- 
addressed CSE mailing labels; two copies of the Student Productivity Index ; fila- 
ment tape; stamped, self-addressed manilla envelopes; and individual school fol- 
ders for each elementary school in the itinerary. Each individual school folder 
contained a School Identification Sheet that provided field evaluators with the 
name and address of the elementary school; an appointment date and time; a per- 
son to ask for when arriving at the school; and the physical location of the in- 
formation needed from the school records (each school was contacted by telephone 
at least a week in advance of a visit and cooperative arrangements made for the 
visit). The School Identification Sheet is reprinted in Figure 22. 

f1|urt22 
School l4Mt1f1c«t1oii Shott 



Arti: 
Trtvtl : 

OUtrlct InfonMtlon: 
(If rtltvMt) 

SQtOOL IDtMTIfiaTlOW SNtr 

Him of School 

Mrt%t 



PhOftt Hm^r 

04tt of VUtt T1 — 

Fltld CvtlM«Ur*i « 

Contict Nrtoft tt ScKdol - 
Nui^r of CSE Survv KlU Mllod to school 

locjUv of ; 

ftn AtU»»d*rtct «Kori» 

fir«4t.0(it l1rthd«Ui - 

Gridt Ono Ethnic NMitrthIp 1 

(rA4t Ofto Sm Informitlofi ^ — — ■ 
(r«4t Two Sfrint 1973 Ceopontlvt frMry THtft 

Spodtl InstructlOM _ 



in c«st of uXffm difficulty, coll: 

ArUnt Fink Miwrton MoJ*iMphy 

Ralph HoopfMr Jtn UioM tt (2U) t2S*47n 
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The individual school folder also contained one School Record Roster for 
each teacher's kindergarten, first, or second grade class that was prepared from 
the school's rosters. The uses of the School Record Roster are described in 
greater detail below. Finally, each individual school folder contained a School 
Experience Form that the field evaluator filled out to help CSE keep a check on 
possible problems experienced by the evaluators or schools. The School Experi- 
ence Form is reproduced in Figure 23* 

rifwrt u 
ScUmI EnHHtRCt Hm 

► mm •f ScHtil ^ _ 

Tiir Htm 

1. VliltlRf CiMiiUry ScHmU 



2. CollKtlfif v4 llttttniliif CSC S«my KtU 



). Ilturilfii lAfoTMtlM m th« SdiMl Mari KHUre 



CoiihU: 



Field evaluators were instructed to always carry the business card provided 
by CSE as a formal introduction intc the schools. Further, they were advised 
to call the contact person named on the School Identification Sheet to intro- 
duce themselves before a visit and to re-check the school's address and location. 
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Collecting and returning CSE Survey Kits . The directions to field evalu- 
ators concerning the collection and return of the Survey Kits were as follows; 



1. CNck to %tt tMt »cy Mve conKt94 the 4ppfOPfi*te *w^r of C$£ S«nrty tMt tut 
CMstio*^irc\ ifKl Indies art co^plMttf. 

2. P«ck «n cooUtrJ CSE S«fv«r <it$ iwtD Ui* c*fton th«t ««* usM to thtw to the scnoor. 
(ir tht C4rtOA 4) no lon^tr <f«niOt(. yoy mitt ottlfn « acw one). 

3. Piste the l«te1 with Csfs iMrest oter the old UMl. The CSC retyrn UMl cen oe fowh< the 
School folders ?«cut. Cktr« 1«teh «re ettKhetf to thts feldtr. 

*. Tie the c*rto« with mei^t t*pe. fovM in the School folden Picket. 

S. MpH the c4rtft« tn csf: SpecUl fowrth CUsi tetOt end Tfcere the colt of the POtUoe. 



Possible problems in collecting and returning the Kits, and their solutions 
were also provided: 



Pr9b\tmu yo« cMmot collKt the iKmr<«U h»ii*er of CSC Survey Kits end/or AttUvde to Sd^ooJ 
CuetttofMmm. becMse teni teichen heve not cenfUted the*. 

Solytfeit: Try to cofnrifice the icheel of tht («MftMct of obUtniM tlie Infomitton. For eiN^U. 
you mi^t wmnion the Ated to tnclwde it «iiiy cMldren «« petttkle in ttie tHf evelMtlvt ttedy. 
*«d point oyt tMt Vm CeUfemti lefttUtyre miU M mkim fvfH<M decUlont on the UH% ef 
tih«t «e find, it the tcMel tt «t1Un9. heve the tUff Mil yo« the Mts. tf fiectttify. ir*- 
vide the* uith « csC 1«M1 for the loaes. 

Profrlw: Toy cmnot collKt the ipfpooriete itwMr of tndciH. 

Solution: Try pertuetlon. If tucceiiful. provide one of the ttiPiped eddretsH mntlU envoi epet 
included In the School feldert Pecket (eatr« copies «r« elto iMlvded In the foldtr). ie Mre 
to (fTite the nine of the ichool. the t««cher*t niM. Md tM qnde level «t the top of Vm 
Index. 



Recording information on the School Record Rosters , The School Record 
Rosters for each school 'contained the name of each student in a kindergarten, 
first-, or second-grade class and the name of the teacher. The School Record 
Roster is given in Figure 24. 

Field evaluators were told to record the needed information and were 
advised that: 

1. The location or whereabouts of the information, e,g., attendance 
records for computing the number of days each child was absent during 
the Fall, 1973 semester. Is provided for you on the School Identi- 
fication Sheet. 

2. As soon as you arrive at the school, find out from the school contact: 

a. The type of enrichment program. If any, at the school 

b. The number of days in the Fall semester 

c. The state school code 

As can be readily seen from the example of the School Record Roster 
illustrated in Figure 24, while the attendance information and the Cooperative 
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BEST COPY AVAIUIBIE 

School Kt(ord Rosttr 



Vl'i tMlitm taMftt ifm muOmm 
Ut\r OilAMi MM* MM 

f«ii<w nnuiii — mu 1 — 
Nii>«T — ntu III ^ 


t 

wsnx 


SclMl CaAi. 








Si*t« Ullaiutl~^ Otter 




M>. of 4ax«. mi 'U SMMtw 


SNoett 

MMC 






Ktiy Uwl TMt 


J^u«*7t Cmmtmiv* 
rriMrr TMt CMWtiM 


1" 
«t 

if 
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33 
j 1 
3 


I* 

i 
1 

ji 


CllMU 

cm* 


] 
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I* 
f 
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5 
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JL 


jf 
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1 

1 




- 

1 


1 

1 

I 


s 

i 
s 

1 


i 
1 



























































































































































































































































































































































































































































































































































































































































































































































































































































































































































































































































































































Primary scores were available from the schools, the scores for the Entry Level 
Test were not* These scores had to be obtained from the company that main- 
tains the statewide computer bank of scores ♦ The computer bank stores individ- 
ual scores, but the scores are coded only by birthdate, ethnicity, sex, and 
socio-economic Index of each student. It is for this reason that information 
collected on the School Record Roster for all first-grade students is entirely 
descriptive. The computer bank was searched to match descriptions within 
schools so that Entry Level Test scores could be assigned to students. CSE 
gratefully acknowledges the cooperation of Westinghouse Learning Corporation » 
the agency charged with the computer bank, for its indispensable help in data 
retrieval for the first-grade test data. 
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DATA ANALYSIS 

This chapter of the evaluation report presents the more technical aspects 
of the evaluation study including the formulation of the hypotheses and the 
procedures for analyzing the data. 

The Evaluation Questions as Evaluation Hypotheses 
The Heed for Hypotheses 

Experts in the field of evaluation of social and educational programs 
have not addressed in a comprehensive manner the issue of whether clear ex- 
perimental hypotheses must, be stated in the development of evaluation designs 
or in the accompanying analysis procedures. CSE conceptualized the present 
evaluation study as an applied experiment and consequently translated the 
primary evaluation questions into formalized statements of hypotheses. This 
procedure was employed for two compelling reasons. 

First, the results of the evaluation study were to be supplied to the 
State Legislature and the Legislature would necessarily have to generalize the 
findings to pre-school education and into the future of the State Preschool 
Program. Interpreting the findings of the evaluation study in terms of formalized 
hypotheses provides the Legislature with built-in indexes of confidence from 
which they may make generalizations in the most enlightened manner. 

Second, the res ilts of the evaluation study could have considerable socio- 
political implications in terms of continued, altered, or terminated funding 
of a somewhat controversial program. Because how one interprets evaluation 
findings is subtly influenced by the nature of the original questions (hypo- 
theses), it was important for CSE to maintain its integrity by formally and 
precisely stating hypotheses before any of the evaluation findings became known. 
CSE believed that if these hypotheses were based upon a scrupulously careful 
consideration of all possible influences on the evaluation findings, then the 
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objectivity of the interpretation of the findings would be greatly enhanced. 
The Influence of the Pre-Existing Samples 

Hypotheses that form parts of experimental designs are all based upon the 
supposition that the populations giving rise to the samples to be compared 
after the educational treatment were essentially aqual before the treatment. 
This is usually assured through some variety of random sampling or random 
assignment. However, the case of applied experiments or evaluation studies like 
this examination of the Preschool Program (and for the Children's Center Pro- 
gram), initial selection of participants into the programs was not random and 
there is reason to believe that the children in the three groups of this evalu- 
ation study represent populations of young children characterized by different 
degrees of what is called "educational disadvantage." This initial inequality 
of the groups affected the nature of the formally stated hypotheses and thus 
how the findings were interpreted. 

Reasons why the groups are initially equal. The sampling of all students 
in each of the three groups was made within schools and within classrooms. That 
is, for each child in the Preschool Program, a child for each of the other two 
groups was (attempted to be) selected who was from the same classroom. No 
attempt was made to match children across classrooms or schools. Even if the 
classrooms were rigidly tracked by ability level (or any other characteristic), 
a^d even if the schools were rigidly segregated according to any socio-economic 
or racial and ethnic basis, the sampling procedure employed in this evaluation 
study maximized the equality of the students in each of the groups. On the . 
basis of this evaluation study's sampling approach, the three groups should 
exhibit initial equality and normal experimental hypotheses should be appro- 
priate. But the evidence for the initial inequality among the three groups is 
much greater and CSE made every effort to give that evidence due consideration 
in the formulation of hypotheses. 
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Reasons why the groups are initially unequal Not only can the children 
be looked at on the basis of the sampling procedures for the evaluation study, 
but they can also be looked at on the basis of how they were selected (or not 
selected) one, two, or three years previously into their respective pre-school 
experiences. If such selection was not essentially random, then there is evi- 
denice that the three groups were not initially equal. To determine if the 
nature of the criteria would result in random selection, the eligibility re- 
quirements for each of the two programs. Preschool and Children's Centers, had 
to be considered in comparison to the No-Program children. 

BEST COnr AVAIUBIE 

Tatit 9 

S«v11ii9 Efftcts of rrt-ScHpol fn^rm Elislbillty ReQulrwtnts 



tests for 
rotontftl 

laoQMlttjr 


froscfiool OilKrtfi 


Cklltfrtn's Center ClilMrcft 


No Prop'm Children (uho 
attend elMntary schools 
Kith frtschool and Children's 
Center children) 


Socio* 
Ecw^c 

SUtHS 


m%t bt AfOC rtctplcRt. 
froB 1oiclncoi« fMifly. 
Miftf* rKlpflfit* or 
tcoftoalully diMtfvM- 
t«904. 


Mrtt be current, fonvr, 
or potential /IFK recip- 
ient, parert clUter 
ployed* In tralnlnf. or in 
sdMoi. My child «ay be 
enrolled, if tkerie_is SMce. 
tet priority 900% to chil- 
dren aeotliif criteria above. 


Mot fcnoMn; probably covers 
aost of the soclo>econoa1c 
ranfe. Mith likely tndti rep 
resenutlon of upper^ddle 
and upper classes. 


Cttlteral 
Offftr«iC«S 


frofortace ftvo* to 
noiKEiifl i sli*spoak i nf 
ftaHlts. ond to tue 
socftlly m4 mnirm* 
oanUlty ^itU^mUmi. 


Hot known; no cultural 
Ttquinaents. 


Not knonn; probably very 
heterofeneoit. 


RACfAl/EClHlIC 


2% Hmritm Ml«i; 
mitock; nOrlonUI; 
yn Sn*Is<» /ImHcm; 
371 Otfter Wilu (os 
jBiUliiid froa Taklc 1). 


SKMiiU; 271 Hack; 
lOt Chicano; IS Chlresc; 
1 S Native JlMrlc«i; 
n Other. 


U Jbvrfcan tndlaa; Its 
Hack; IsOHenul; 2iS 
Spvilsh JUttrican; Sn Other 
miU (as obtained froa 
Tabic 2). 


in E*iC4tfoii 


Mrtnts sMt onroll 
tlw dilU «i4 bt 
fmotvod In tkt tAi- 
cotfOMi profrw. 


^arenu MSt enroll the 
child and mst partfclpau; 
b«t participation Is often 
vtrylnal because aoit 
parents «orfc or 90 to 
school. 


Not knoun; could roofe fro* 
■align neflect to IntOMe 
lAvo1««oent In private pre* 
school profraa. 



•SUU cvMiwt fl|«r« for dilMmt, afttf 3, to S. I» '»« "jr*: 8X »«g;;.T?«-*lt;; K Jywtw ; 
m Sm«1>Ii Mnun; « tmrUn t»tim: U CiilMu: IX Filipino. ««cliI/Et!iiilc mwli 
•r* canlitant altk tktir *«io«t direct mi Indirect tourcn. 



Table 9, presenting general eligibility criteria for the three groups that 
could cause sampling inequalities, indicates that the three groups of children 
cannot be considered to be random (and therefore equal) samples of the popula- 
tion of California pre -school -aged children. Based upon the number and biasing 
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effects of the eligibility criteria, it was inferred that initially the Preschool 
children were most economically disadvantaged, leading to the conclusion that they 
were the most educationally disadvantaged; the Children's Center children were 
second in terms of educational disadvantage; the No-Program children were least 
educationally disadvantaged. 
The Evaluation Hypotheses 

Because of the importance of the hypotheses in addressing the limitation result- 
■ ing from the lack of baseline data, it was necessary to formulate them in a unique 
way. For this reason, the rationale for the hypotheses is presented in detail. 

If, on the generalized dependent variable of educational advantage, up stands 
for the mean of the population P of participants in the Preschool Program, y^. for 
the mean of the population C of children who had experiences in the Children's Center 
Program, and y^j for the mean of the population N of children who had taken part in 
no institutionalized program, a basis is furnished for formulating each of several 
possible hypotheses. 

Hypotheses for two-group comparisons. Initially, consideration will be given to 
comparisons between populations P and N, as population C constitutes, in a sense, an 
additional benefit or dividend of importance but not of vital significance. It can 
be argued, on the basis of the previous discussion, that despite the care taken in 
sampling, there may be a slight built-in advantage for children in the N population, 
as the lack of prior participation in an institutionalized pre-school program could 
indicate for population N the somewhat enhanced probability of a slightly higher 
socio-economic level in the home and of a somewhat more advantageous hone environ- 
ment for learning than that found for children in population P. (The alternative, 
that many of the children from population N are from families so disadvantaged that 
their parents didn't even know about or care about the possibility of a pre-school 
experience, was not considered highly likely.) 
• Hence, it is not un''ikely that if the members of population P had not received 
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any pre-school program, their average level of academic performance, motivation, 
and productivity would have been lower than that of population N. The equation 
below describes this probablistic situation: 

Thus it would appear that if the mean academic performance, motivations, and pro- 
ductivity level of individuals in population P after the P reschool experience 
were at least equal to that of population N, there would be reason to conclude 
that the Preschool Program was successful. This finding would indicate that the 
Preschool Program brought the disadvantaged children ug. to (but not above) the 
level o-*' ♦:he No-Program children and would be interpreted as evidence that the 
Preschool Program probably was successful in meeting its goals. The equation 
that illustrates the condition under which the Preschool Program would be adjudged 
a probable success is: 

The Preschool Program would be adjudged a definite success if: 

Although it is customary in a directional hypothesis involving a one-tailed 
significance test (relative to which the substantive research-oriented prediction 
ftx)m a theoretical frame work would be that the mean of the Preschool population 
wotfld be greater than the mean of the No-Program population) to state the null 
hypothesis (Hq) and the alternative hypothesis (H^^) as 

"a- ^p^^' 

it is conceivable (precisely as happened in this evaluation stu(<y) that there 
could be a situation in which the expectation for the evaluation hypothesis would 
be that the average level of the experimental (Preschool) population would be 
equal to or greater than that of the control (No-Program) population, and that the 
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null hypothesis would indicate that tha mean of the experimental (Preschool Pro- 
gram) population would be less than (but not equal to) that of the control (No- 
Program) population, as evidenced by the following statements: 

"O- ^p < 

"a- ^p^^N 

For the investigation involving populations P and N, it would seem reasonable from 
the argument previously presented that the null hypothesis and alternative (evalu- 
ation) hypothesis be stated as above. 

To formulate the null hypothesis Hq as a non-directional one of no difference, 
in which either a positive or negative sanpling difference between means would 
be entertained as a highly likely occurrence, would seem to be an evasive tactic, 
as there appears to be a reasonable expectation on the part of the legislators 
and members of the teaching and home communities that children given the Pre- 
school experience should do in subsequent primary grades at least as well as" similar 
children not afforded such an opportunity. To argue that disadvantaged children 
in the Preschool Program would exhibit, on the average, a level of performance 
superior to that of somewhat less-dis advantaged children, would be to expect more 
from the Preschool Program than would be expected from any other educative program, 
and this would be unrealistic, and probably unfairly discriminatory. By the 
same token, to argue that the Preschool Program could not erase the deficit of the 
disadvantaged child, but merely make it smaller, would be to inject an element 
of fatalistic pessimism for the intervention approach. ThuSf the formulation 
afforded by the adopted hypotheses seemed on both research-evaluation and poli- 
tical-humanistic grounds the. most reasonable and pragmatic one. 

The hypotheses for the cowparisans between the Preschool childxen and the 
No-^Program children were evaluated as follows: Significantly greater improvement 
of the Preschool children was interpreted as indicating a definite success of 
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^ the Program; any non-significant difference between the programs was interpreted 
as indicating a probable success of the Preschool Program; and any significantly 
greater improvement of the No-Program children was interpreted as indicating a 
definite failure of the Preschool Program. In the usual evaluation study these 
criteria would be considered exceedingly one-sided in allowing the Preschool 
Program to merit positive evaluation; however, CSE believed that the possibility 
of initial sairtpling bias warranted this more liberal approach. 

Hypotheses for three-group comparisons^ If the third population, C, is 
injected into the discussion, many interesting possibilities could arise from 
the standpoint of the research hypotheses. The two most likely expectations 
would be: 

or 

The second alternative hypothesis, Ag, allows for the nrininal expectation of 
equality to be achieved; and the first alternative hypothesis. A-,, for the ful- 
fillment of the somewhat hopeful "underdog" expectation that the disadvantaged 
children in the enriching Preschool Program would excel those in the Children's 
Center Program who, in turn, would excel children not receiving any institution- 
alized pre-school experience. Both alternatives were combined to provide the 
operating evaluation hypothesis: 

with interpretations similar to those for the two-population case. 

• It is conceivable that the non-effectiveness of the pre-school experiences 
or the realities of the differences caused by disadvantaged conditions might 
yield the following nul hypothesis: 

^p <^C <^N. 

with accompanying negative evaluation interpretations for the pre-school experience 
programs. 
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The hypotheses for the comparisons among the Preschool, Children's Center, 
and No-Program children partly repeat those for the two-group comparisons discussed 
above. For that reason, the three^group hypotheses were evaluated primarily 
for the Preschool vs. Children's Center comparisons, with No^-Program comparisons 
playing a secondary role. The hypotheses were evaluated as follows^ Significantly 
greater improvement of the Preschool children over the Children's Center children 
was ^interpreted as indicating that the Preschool Program was definitely more 
successful than the Children's Center Program; any nonsignificant difference 
between the Preschool Children and the Children's Center children was interpreted 
as indicating that the Preschool Program was probably more successful than the 
Children' s Center Program; any significantly greater improvement of the Children' s 
Center children over the Preschool children was interpreted as indicating that 
the Children's Center Program was definitely more successful than the Preschool 
Program. Each of these interpretations was further tempered, of course, with 
the observed differences from the No-Program children. As with the two-group 
criteria, these would be considered exceedingly one-sided in allowing the Pre- 
school Program to. merit positive evaluation in comparison to the Children's Centers 
by traditional evaluation standards. CSE still believed that the possibility 
of initial sampling bias warranted this more liberal approach. 

Hypothesis for Preschool purposes comparisons ^ The fact that the sample 
of Preschool agencies employed in this evaluation stucly could be categorized 
into three different groups on the basis of their self-reported priorities or 
purposes allowed for a comparison among the three groups in terms of the depen- 
dent variables reflecting levels of performance, motivation, and productivity. 
Because the categorization of the Preschool agencies was not based on any pre- 
conceived plan, but was made empirically according to the findings of the Pre- 
school Purpose Survey, no directional hypotheses were made regarding the possible 
differences among the groups. The non-directional evaluation hypothesis for the 
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Preacademi c Skills population (A), the Socialization and Interaction Skills popula- 
tion (S), and the Attitudes to School and Learning population (L), is stated as 

"a- ^I^^^S^ \* 
while the null hypothesis is stated. as 

"O- ^^A = ^'S = \' 

With a non-directional hypothesis , any observed significant difference among 
the groups of Preschool agencies can be reported as information that might be useful 
for decision making by the Legislature, and therefore was reported in that fashion. 

Hypothesis for school -enrichment conparisons. Based upon the literature 
cited previously on page 51 of this evaluation report, the following directional 
hypothesis was made regarding the differences between the means of the Low-Enrich- 
ment schools (Low) and the High-Enrichment schools (High): 

"a- \ow ^ %*gh' 
The concommitant null hypothesis would read: 

"o^ ^^Low-^'gh- 

It was considered that rejection or non-rejection of the null hypothesis would 
have no direct decision-making implications for the Legislatu;^, but would only 
be useful for a more careful consideration of implications from other statisti- 
cal tests described above. It was also thought that the findings for the 
"enrichment'* comparisons, secondary concerns in the two-group and three-group 
comparison analyses, should not be interpreted as an evaluation of the general 
"enrichment" policy, because High and Low schools might have been different 
on other characteristics (such as concentration of disadvantaged childreri). 
It could be argued, for example, that since enrichment programs are ^in 
general) provided where they are most needed, equal achievement would be an 
indication of probably success. Thus the findings were meant to be interpreted 
only in a "maintenance" perspective. 
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Analysis Methods to Test the Hypotheses 
The analysis method selected to test all the hypotheses of this evaluation 
study was the univariate analysis of variance. While analysis of covariance 
would be an appropriate method, especially where the comparison groups are un- 
equal in many relevant respects, no measures that could qualify as covariates 
were available for most of the children in all three* groups* For example, al-- 
though Bettye Caldwell's Preschool Inventory was administered to a state-wide 
sample of Head Start children during the years of concern to this evaluation 
study, and Head Start programs were frequently commingled with Preschool and 
Children'.s Center Programs, none of the No-Program children could be expected 
to have taken the test during their pre-school years, and there would therefore 
be no way to adjust for their differences. 

Analyses to compare Preschool to No-Program children . At each of the three 
grade levels and for each of the measures taken at the respective grade, a two- 
way analysis of variance was performed. One dimension was the Preschool-No- 
Program comparison and the second dimension was the Low - High school -enrichment 
comparison* The comparisons are graphically presented in Figure 25. 

Figure 25 

Preschool vs. No-Program Comparisons 



Preschool Program No-Program 

Low Enrichment 
High Enrichment 

F tests for the first main effe, icomparing the two right columns) indi- 
cated whether or not the Preschool children exceeded or were equal to (or lower 

than) the No-Program children, without consideration of their elementary school 

programs. F tests for the second main effect (comparing the two bottom rows) 
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indicated whether the children in High-Enriched elementary schools exceeded (or 
were equal to or lower than) children in Low- Enrichment elementary schools, 
ignoring their pre-school experiences. F tests for the interaction (comparing 
both columns anJ rows simultaneously) indicated whether school enrichment worked 
to enhance, maintain, diminish, or reverse any effects of the two pre-school 
experi ences. 

Analyses to compare Preschool to Children's Center to No-Program childre n. 
At each cf three grade levels and for each of the measures taken at the respec- 
tive grade, a two-way analysis of variance was performed. The samples of students 
for this analysis were composed of all the cases from classrooms in which all 
three types of children (in terms of their pre-school experiences) were found. 
One dimension of the analysis was the Preschool - Children's Center - No-Program 
comparison, and the second dimension was the Low - High school -enrichment compari- 
son. The comparisons are graphically presented in Figure 26. 

Figure 26 

Preschool vs. Children's Center vs. No-Program Comparisons 



Preschool Program Children's Center No-Program 

Low Enrichment 
High Enrichment 

F tests for the first main effect (comparing the three right columns) indi- 
cated whether or not the Preschool children exceeded or were equal to (or lower 
than) the Children's Center children who, in turn, exceeded or were equal to 
(or lower than) the No-Program children without consideration of their elementary 
school programs. F tests for the second main effect (comparing the two bottom 
rows) indicated whether the children in High-Enrichment elementary schools exceeded 
(or were equal to or lower than) children in Low-Enrichment elementary schools, 
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ignoring their pre-school experiences. F tests for the interaction (comparing 
both columns and rows simultaneously) indicated whether school enrichment worked 
to enhance, maintain, diminish, or reverse any effects of the three pre-school 
experiences. The comparisons made for the first main effect, when significant, 
were followed by post hoc comparisons to find just which groups were different 
from one another. 

Analyses to conpare the effects of different Preschool purposes. At each 
of the three grade levels and for each of the measures taken at th6 respective 
grade, a one-way analysis of variance was performed over the three types of 
Preschool purposes. The samples of students for this analysis were composed 
only of those students who had completed Preschool experiences. The one dimen- 
sion of the analysis was the Preacademic Skills - Socialization and Interaction 
Skills - Attitudes to School and Learning comparisons among the Preschool 's self- 
described priority purpose. The comparisons are graphically presented in Fig- 
ure 27. 

Figure 27 
Preschool Purposes Comparisons 



Preacademic Socialization and Attitudes to School 

Skills Interaction Skills and Learning 



An F test for the main effect (comparing the three columns) indicated whether 
or not there were differences among children from the three differently focused 
Preschool agencies. If the tests were significant, they were followed by post hoc 
comparisons to determine which type of Preschool had the most positive effect on 
which type of student outcome. 

Because of the extreme care taken in the sampling of children to represent 
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each of the groups being compired in any of the analyses described above and be- 
cause in many Instances statistical equality was to be liberally Interpreted as 
somewhat confirmatory of hypotheses, the .05 level of significance was adopted 
for the evaluation of all the inferential statistical tests. 



EVALUATION FINDINGS 



Comparison of Preschool Children to No-Proqram Children 
To test for differences between Preschool and No-Program children, at each 
grade level and for each measure, a two-way analysis of variance was conducted. 
The basic design for this analysis, presented in Figure 25, is outlined in the 
previous chapter. 
Differences in Performance 

Two measures of performance were considered: the Entry Level Test for 
first-grade students and the Cooperative Primary Test - Reading for second-grade 
students. The results of the analysis for each measure are presented in Tables 
10 and 11, respectively. (Throughout this chapter, the abbreviations appearing 
in the tables are: N = sample size; M = mean value; df = degrees of freedom; 
F = F value; p = probability value; and ns = not significant.) 
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Entry Level Te$t > No statistically significant differences In performance 
were found between Preschool and No-Program children or between Low- Enrichment 
and High-Enrichment children. In addition, tests for interactive effects of 
the Preschool experience and Enrichment were also nonsignificant. 

In terms of the evaluation hypothesis, these results indicate that with 
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respect to performance, as measured by the Entry Level Test ; 

!• The Preschool Program was probably successful in meeting this goal. 
Z. Enrichment had no effect on maintaining student performance. 
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Cooperative Py mary Test - Reading. Comparison of performance between 
Preschool and No-Program children reveals statistically significant differences, 
with the Preschool children (M = 21.88) earning lower scores than the No-Program 
children (M = 23.85). In addition, differences were found between High Enrichment 
and Low Enrichment with the Low-Enrichment children (M = 23.39) surpassing the 
High-Enrichment children (M = 22.42). Tests for an interaction between the 
Preschool experience and Enrichment were nonsignificant. 

In terms of the evaluation hypothesis, these results indicate that for 
performance, as measured by the Cooperative Primary Test - Reading: 

1. The Preschool Program was definitely not successful jnjneeting this goal. 

2. Enrichment appeared tobe detrimental in maintaining performance. 
Summary . For both measures of perforliiance, the Preschool children had 

lower mean scores than the No-Program children. However, the means were only 
significantly different for one of the measures. Therefore, it is concluded 
that the Preschool Program was probably successful in improving first-grade 
performance, but definitely not successful in improving second-grade performance. 
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In addition^ enriched elementary- school prograiTiS did not maintain or enhance 
first-grade improvement, and actually appeared to be detrimental to second-grade 
performance* 

Differences In Motivation 

Two measures of motivation available at each grade level were considered 
in this set of analyses: the Attitude to School Questionnaire (ASQ) and atten- 
dance. The results of the analyses are presented In Table 12 through 14 for the 
Attitude to School Questionnaire and in Tables 15 through 17 for attendance* 
In interpreting the results of these analyses, it should be kept in mind that 
attendance was measured on a reversed scale as percentage of a semester absent* 
Consequently, a lower value represents a "br '".er" score on this measure* 
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Attitude to School Questionnaire. Comparison of Preschool children to No- 
Program children produced nonsignificant differences at each of the three grade 
levels. No significant differences were found between the High-Enrichment and 
Low-Enrichment children except for grade one. In the first grade, Low-Enrichment 
children (M = 20.98) showed higher motivation than the High-Enrichment children 
(M = 19.83). No significant interactions between Preschool experience and 
Enrichment were found at any grade level. 

According to the evaluation hypothesis, these results indicate that in terms 
of motivation, as measured by the Attitude to School Que stionnaire: 

1. The Preschool Program was probably successful in meeting this goal. 

2. Enrichment appeared to hawe no effect on maintaining student motivation 
in kindergarten and the second grade, but appeared to be detrimental In 
maintaining student motivation in the first grade. 
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Attendance > At each grade level, no statistically significant differences 
were produced between the Preschool and No-Program children, or between the 
Low-Enrichment and High-Enrichment children* Further, no interactions were 
found between Preschool experience and Enrichment* 

According to the evaluation hypothesis, these results indicate that in 
terms of motivation, as measured by attendance: 

1. The Preschool Program was probably successful in meeting this goal* 
2* Enrichment had no effect on maintaining student motivation* 
Summary * Even though the mean scores on both measures of motivation at 
most of the grade Jevels were slightly favorable to the No-Program children, 
the differences were not significant* In terms of motivation, it is concluded 
that the Preschool Program probably effected improvenjent, but that the improvement 
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was neither maintained nor enhanced by enriched elementary-school programs, and 
that in one instance, these programs actually appeared detrimental to motivation. 
Differences in Productivity 

For this analysis, the Student Productivity Index was used as the measure 
of productivity at each grade level. It should be kept in mind that the Student 
•Productivity Index uses a reversed scale, with higher scores indicating less 
productivity. The results of this analysis are presented in Tables 18 through 20. 

Student Productivity Index. Statistically significant differences in 
productivity were found between Preschool and No-Program children, with No- 
Program children surpassing the Preschool children at each grade level. (In 
kindergarten Preschool, M =52.37, No-Program, M = 47.60; in grade one Preschool, 
M = 52.22, No-Program, M = 48.23; and in grade two Preschool, M = 0.97, No-Program, 
H = 47.43.) Comparisons between High and Low-Enrichment children at each grade 
level produced no significant results. Similarly, no significant interactions 
were found between Preschool experiences and Enrichment. 

In terms of the evaluation hypothesis, these results indicate that for 
student productivity, as measured by the Student Productivity Index; 

1. The Preschool Program was definitely unsuccessful in meeting this goal. 

2. Enrichment had no effect on maintaining student productivity. 
Summary. The Preschool children exhibited significantly less productivity 

than the No-Program children. In terms of productivity, it is concluded that 
the Preschool Program was definitely not successful in effecting improvement and 
that enrichment at the elementary level had no effect either. 

Comparison of Preschool, Children's Center and No-Program Children 
To test for differences among the Preschool, Children's Center, and No-Pro- 
gram children, a 2X3 analysis of variu.ice was performed. The basic design for 
this analysis, presented in Figure 26, is outlined in the previous chapter. 
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Differences in Performance 

Two measures of performance were considered: the Entry Level Test for 
first-grade students and the Cooperative Primary Test - Reading for second- 
grade students. The results of this analysis for each measure are .presented in 
Tables 21 and 22. 
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Entry Level Test . No statistically significant differences were found 
between Preschool, Children's Center, and No-Program students, or between the 
High-Enrichment and Lov/-Enrichment students. In addition, the test for inter- 
active effects between Preschool experience and Enrichment was nonsignificant. 

According to the evaluation hypothesis, these results indicate that with 
respect to performance, as measured by the Entry Level Test; 

1. The Preschool Program was probably more successful than the Children's 
Center Program in meeting this goal. 

2. Enrichment had no effect on maintaining student performance. 
Cooperative Primary Test - Reading. No significant differences were found 

between the Preschool, Children's Center* and No-Program children. All the mean 
scores In Table 22 are very close to the mean of the published national norms 
for Grade 1 - Spring. Significant differences were produced, however, between 
High and Low Enrjchment, with Low-Enrichment children (M = 24.39) surpassing 
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NevMn-KtuU PItUlple Coap«r1son T«st 

Low CnrlchMiit* Chlltfren Ctr.ter > Hf9^ Enrlchaent, No fnvm p<.01 
LoM CnrfchMnt. Children Center > low Cnrfcfwit* Preschool p<.Ol 
Low enrichment. Children CenUr > High Cnrlchaent, Preschool p<.01 
Low CnrfchMnt, Children Center > High Cnrlchwet, Children Center P<.01 



the High-Enrichment" children (M = 22.04). The test for interaction between 
Preschool experience and Enrichment was also significant. This interaction is 
presented graphically in Figure 28. Inspection of the Low- Enrichment and High- 
Enrichment profiles in Figure 28 reveals that the greatest differences occur 
between Low-Enrichment-Children's Center and High-Enrichment-Children's penter 
students. This result was confirmed by a Newman-Keuls multiple-comparison test: 
Significant cell comparisons occur between the Low-Enrichment-Children's Center 
students and the Low-Enrichment-Preschool students, the High-Enrichment-Preschool 
students, the High-Enrichment-Children's Center students, and the High-Enrichment- 
No-Program students. 



Flgurt 2t 

Intirictlon bctNMii Prtsctaol hpirftnce and CnrlcliMnt: 
Coop«r«t(y« PriMry TMt - MidliKj 



Score on 
Cooptrttlvf 
Prliary Test 
- DitdlM 

1 



25 




Low CnrlcNient 



High CnrlchMrtt 



Preschool Children's Center rto.Progriw 
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In terms of the evaluation hypothesis, these results indicate that for per- 
formance, as measured by the Cooperative Primary Test - Reading: 

1, The Preschool Program was probably more successful than the children's 
Center Program in meeting this goal. 

2o Enrichment appeared to be detrimental in maintaining performance. 

3o Enrichment appeared to be particularly detrimental for Children's 
Center and No-Program students in maintaining performance. 

Summary o The Preschool children earned mean scores that were not signi- 
ficantly different frcm those of the Chidlren's Center children. Children in 
Low-Enrichment schools exhibited higher performance than those in High-Enrichment 
schools. In terms of performance, it is concluded that the Preschool Program 
probably effected improvement more than the Children's Center Program, but that 
none of the improvement was maintained or enhanced by enriched elementary- 
school programs. ^ 
Differences in Motivation 

At each grade level, two measures of motivation were considered for this 
analysis: the Attitude to School Questionnaire and attendance. The results 
of these analyses are presented in Tables 23 through 25 for the Attitude to 
School Questionnaire and in Tables 26 through 28 for attendanceo In^lfterpreting 
the results of the latter analysis , it should be kept in mind that^^attendance 
was measured on a reversed scale as percentage of a semester absent. Consequent- 
ly, a lower value represents a "better" score on this measure. 

Attitude to School Questionnaire. As in the previous analy#s comparing 
Preschool and No-Prpgram children, the comparison of Preschool, Children's 
Center, and No-Program childien produced no statistically significant differ- 
ences at each of the three grade levels. Once again, significant differences 
were found between High-Enrichment and Low-Enrichment children for kinder- 
garten and first-grade students. In both cases, Low-Enrichment children 
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Ubit 23 



AntlysU of AttUudft to School Qutstlonniirt: Grtde k 





Prtschool 


Children Ctnttr 


ho-Proqr«p 


low 

Enrtc^Mnt 


n • 129 
N • 21.00 


n • 74 
N • 21.68 


n • 122 
N • 21.79 


High 

Cnrfehmcnt 


n • 151 
N • 19.66 


N • Sf 

N • 18.07 


n • 162 

N • 20.48 


source 


df 


Ht«n Squire 


r 


P 


Preschool vs. 
Childrto CMttr 
vs. HO'Proqrm 


2 


SI .00 


1.91 


ns 


LOW vs. Hfgh 
EnrkhMtnt 


I 


645.06 


15.19 


p^.01 


InttrKtlon 


2 


87.54 


2.06 


ns 


Error 




42.46 






Antlysts of 


Ttble 24 

Attttudt to School (^tstlonnAirc: 


r,ride 1 




Prtschool 


Chlldrtn Ctnttr 




Low 

CnrlchMOAt 


N • 10 

N • 20.47 


N • 36 

N • 21.03 


N « 81 
H - 20.58 


Ht9h 

EnrfchHont 


N * 133 
H • IS.fiO 


N - 47 

M • 19.57 


H « 133 
N • 18.43 


souice 


df 


Htm Squirt 


r 


P 


Prtschool vs. 
ChlldrtA CMttr 
vs. No.Pro9r«» 


2 


24.51 


.71 


ns 


low vs. Htgh 
EnrfchMnt 


1 


312.94 


9.12 


p<.01 


Inunction 


2 


4.30 


0.10 


ns 


Error 


504 


34.30 







Table 25 

AnalytU of Attltudo to School Qutstlonnelrt: 6r«tft 2 





Preschool 


Children CenUr 


. No'Progre* 


LOW 

Enrtctaent 


N • 57 
M • 20.75 


• N • 22 
N • 20.23 


N - 57 
H • 19.72 


High 

EnrichMtnt 


N • 83 

M • 20.30 


N - 38 

N - 21.11 


N - 87 
N - 19.45 


SOURCE 


df 


Neen Squere 


f 


P 


Pre;choo1 vs. 
Children Center 
vs. No-ProgrM 


2 


31.90 


1.30 


nt 


low vs. High 
Enrichment 


1 


0.18 


.01 


ns 


Interictfon 


Z 


12.01 


.49 


ns 


Error 


338 


24.63 
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showed higher motivation than High-Enrichment children. (In kindergarten, Low 
Enrichment. M « 21.45, High Enrichment, M « 19.79; In first grade, Low Enrich^ 
inent, M » 20.62, High Enrichment, M ■ 18.76.) No significant Interactions 
between Preschool experience and Enrichment were produced at any grade level. 

According to the evaluation hypothesis, these results Indicate that In 
terms of motivation, as measured by the Attitude to School QufeStlonnaIre ; 

1- The Preschool Program was probably more successful than the Children's 
Center Program In meeting this goal. 

2. Enrichment appeared to be detrimental In malntalnlnq student motivation for 
the Kindergarten and first-grade students, and had no effect In main- 
taining student motivation In the second grade. 



Ttklt t* 

AMlytlt of f«rCMt*f* «' S«MiUr MiMt: tnU t 





Prtlchool 


Chlldrtn CiAttr 


NO'Proqran 


Low 

CnrlcrvMOt 


N • 13S 
N« 11.90 


N • 90 

N • 7.61 


N • 1)0 
N • 9.7S 


Enrtchntnt 


N* 169 

M* 11.13 


N • 60 
N • 9.S8 


N • 159 
N • 11.10 


SOURCE 


df 


Mean Squart 


F 


P 


PrMchool v». 
ChOdrtA Ctflttr 
vs. No.Pro^riii 


2 


412.9S 


4.04 


P'.05 


Low VI. High 
EnrlchMtfit 


1 


141.65 


1.39 


ns 


Intiractfon 


2 


121.29 


1.26 


nt 


frror 


727 


102.13 







KftiMffKiuU NultlpU CoMparUoA Test ^ 

CMIdrm CtnUr < Prttchool 
Children Ctotir < llo>^o«raii 



Ttbit 27 

Afiilytit of NrcMtHt of $«MlUf AMOfit: ttrodi 1 





r>^lchoo1 


Chlldron Ctntir 


fto* Program 


Low 

Cnr1c)P«ftt 


N • IS 

N • 9.07 


N • 34 

N • 7.59 


N • 83 
N • 8.63 


Hlffh 


N • 136 
N • 1.27 


H • 50 
N • 11.14 


N • 138 
N • 8.95 


umt 


df 


Mean Squire 


f 


P 


Pros choc 1 VI. 
Cht1Ur«t CtAttr 
n. HO'Progra* 


2 


11.33 


.13 


ni 


LOW VI. High 
EnrlcNNtnt 


1 


58.96 


.65 


ni 


Interaction 


2 


231.41 


2.57 , 


ni 


Error 


520 


90.19 
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^rtschool 


Chfldrtn Ctnttr 


No*Pro9rM 


low 


N « <t 
N • €.17 


N • 22 
N « 4.50 


N • 62 
N • 6.64 


Ht9n 

(nrUhntnt 


N • M 

n • 5.« 


N • 37 
N • 7.57 


N • 69 

N • 7.36 




df 


,Mc«n Sqgirt 


r 


P 


Preschool vs. 
ChftOrtn Ctnttr 
vs. No^ProQrOA 


2 


21.18 


.56 




low vs. Hl^h 
Cnrlch«tnt 


1 


50.02 


1.15 


nt 


InttrKtlon 


2 


H.40 


1.91 


ns 


irror 


353 


47.76 







Attendance . Tests for differences in attendance among Preschool, Children's 
Center, and No-Program children were significant only for kindergarten. (Pre- 
school, M = 11.47; Children's Center, M = 8.59; No-Program, M = 10.51.) Multi- 
ple-comparison Newman-Keuls tests performed for the kindergarten analysis revealed 
that the Children's Center students had significantly better attendance records 
than the Preschool Program and No-Program children. No statistically -^gnifi- 
cant differences were found between Low-Enrichment and High-Enrichment children. 
At each grade level, tests for interaction between Preschool ^ ,3rience and 
Enrichment were also nonsignificant. 

In terms of the evaluation hypothesis, these results indicate that for 
motivation, as measured by attendance: 

1. In kindergarten, the Children's Center Program was definitely more 
successful "than the Preschool Program, while at grades one and two 
the Preschool Program was probably more successful than the Children's 
Center Program in meeting this goal. 

2. Enrichment had no effect on maintaining student motivation. 

Summary . Slightly differing conclusions must be drawn regarding the com- 
parison of the Preschool Program to the Children's Center Program in terms of 
improvement in motivation. With the exception of the attendance measure at 
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the kindergarten level, the Preschool Program was probably more successful In 
improving ssotivation. Enrichment at the elementary level either has no main- 
tenance effect on the motivation or else depresses it. 
Differences in Productivity • "* 

For this analysis, productivity was measured by the Student Productivity 
' Index (a reversed scale) at each grade level. In tables 29 through 31 the re- 
sults of this analysis are presented. 



TMU n 

AMljnlt (f SMMt rr«*Ktl«lty IMtil;. CrMt K 





Prttchool 


CMUrtn Ctftttr 




Low 

{nrlchnMt 


n • U7 

n « $0.2) 


N • 79 
H « 47.H 


n « 129 
H • 4(.42 


(nrlctwMt 


N • 117 


N • S7 


N • 172 
« • 47.$« 




df 




f 


P 


frtichool vt, 
ChkUrtft Unttr 


2 


1201. SS 


KM 


At 


lew vs. Mqts 
CnriclvMtflt 


1 




0.93 


ftl 


lnttr«cttoA 


2 


50.94 


0.0« 


ni 


[rror 


73S 


899.29 







Ttblt 30 

AMiytU of StvdtAt ProtfuctWIty lnd«xi ftrjidft 1 





tr«(chec1 


ChlUrtn Ctflttr 




Low 


N • 89 
»• • 5).4) 


n * 31 
H « 5I.3« 


H • 87 

H • 50.55 




II • 13S 
N • 41.09 


N • SI 
H • 47.59 


N • 139 
H • 48.84 


SOOKC 




Ntin Squirt 


f 


P 


Prtichpol vt. 
Chlldrtft Ctnttr 
y>. No-Pro9rM 


2 


17.(4 


.07 


AS 


Low vt, Kl9h 
£nrtctM(«nt 


1 


1384.1) 


1.51 


fit 


Inttrictlon 


2 


ns.92 


.13 


nt 


trror | s)1 


911.90 
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AMtyils Of StuiMt ProAictivl^ InitB: 6r«it 2 





Preschool 


CnfUrcn C«fiUr 


H0*Proqrjn 


Low 

£nrlcNNtit 


N - 43 
N - 49.32 


11-23 
N • 46.4t 


N - 64 

N - 44.S6 


£nrf cNi^t 


N • 9) 
H - S$.t7 


N - 41 

N - 47.22 


11-89 
N • 49.0S 


SOUftC£ 




Nc«n Squire 


r 


P 


PrcscDoo) vs. 
ChiUrttt Ctnur 
vs. flo-IVo9r««i 


2 


909.71 


1.02 


ns 


lott vs. High 
£nrlc)ncAt 


] 


) 349.61 


1.S2 


ns 


InterKtlon 


2 


216.92 


.32 


ns 


Error 


3iS 









Student Productivity Index. No statistically significant differences in 
productivity between Preschool, Children's Center, and No-Program children were 
produced. Comparisons between High-and Low-Enrichment Programs at. each grade 
level also produced no significant results. Finally, tests for Preschool ex- 
perience by Enrichment interactions were nonsignificant. 

In terms of the evaluation hypothesis, these results indicate that for 
student productivity, as measured by the Student Productivity Index; 

1. The Preschool Program was probably more successful than the Children's 
Center Program in meeting this goal. 

2. Enrichment had no effect on maintaining scudent productivity. 
Summary. The Preschool children earned average productivity scores that 

were higher, ind-fcating less productivity, than the Children's Center children 
earned, but the differences were not significant. In terms of productivity, 
it is therefore concluded that the Pi^eschool Program was probably successful 
in effecting improvement and that enrichment at the elementary level had no 
effect on it. 

Comparison Among Preschool Purposes 
To compare performance, motivation, and productivity among students in 
Preschools with differing purposes, a one-way analysis of variance was performed. 
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The basic design for this analysis, presented in Figure 27, is outlined in the 
previous chapter. 
Differences in Performance 

Two measures of performance were considered: the Entry Level Test for 
first-grade students and the Cooperative Primary Test - Reading for second-grade 
students. The results of this analysis for each measure are presented in 
Tables 32 and 33. 



Ttbit n 

/Intlysis of £«tnf TMt: trt*t 1 



Preicidtwic 


SocUl wd 
tfittractloMl Skills 


Attitudes to 
School OAd tfrnlnp 


» « 483 

H* 26.56 


R - 111 
H • 26.41 


N ^ 130 
H • 26.81 


SOUftCE 




HtM S^rt 


F 


P 


Purpose 


2 


S.06 


.14 


ns 


Error 


721 


36.41 







Entry Level Test. No statistically significant differences were found 
between Preschools emphasizing Preacademic Skills, Socialization and Interaction 
Skills, or Attitudes to School and Learning. 

According to the evaluation hypothesis, this result suggests that Preschool 
Purpose did not influence student's performance as measured by the Entry Level 
Test. • . 



UMt 33 

tMiftlt of Coo»tr»t«»t friMry lMt-M«)ln«: Gr«l» 2 



Preacodnlc 


SocUl «nd 
tnUrictloful Skills 


Attftudils to 
School M>d Lc«mU9 


N • 384 

H • 21.77 


n • 77 

H • 23.69 


n - 126 

M • 21.12 
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df 
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F 


P 


Purposo 


2 


164. S3 


2.49 


ns 


Error 


S84 


66.06 
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Cooperative Primary Test - Reading. No significant differences were found 
among Preschools with differing purposes. In terms of the evaluation hypothesis, 
this result suggests that Preschool Purpose does not influence students* per- 
formance as measured by the Cooperative Primary Test - Reading. 

Summary. Variations in the purposes of Preschools had no effect upon 
later performance of their students. 
Differences in Motivation 

At each grade level, tno measures of motivation were considered: The Atti- 
tude to School Questionnaire and attendance. The results of the analyses 
are presented in Tables 34 through 36 for the Attitude to School Questionnaire 
and in Tables 37 through 39 for attendance. In interpreting the results of this 
latter analysis. It should be kept In mind that attendance was measured on a 
reversed scale as percentage of a semester absent. Consequently, a lower value 
represents a "better" score on this measure. 



T«blt 34 

Aiulysls of Attitude to School QuMtionnairt: Grate K 





Social and 
lAtoractlonal SktUt 


AttttudtS to 
School and Leamtno 


N • 694 

N • 20.05 


N • I4S 

N • 19.S3 


N« 202 
M * 20.37 


SOUIICE 


df 


Ntan SqMrc 


F 


P 


Purpose 


2 


29.S4 


.70 
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Error 


I03S 


42.87 







Table 3S 

Analysis of Attitude to School OiWtioiwaJre: Grade I 



Preacadaale 


Social antf « 
Iftteractlonal Skills 


Attltudts to 
School and Leamin<) 


N • S79 
N • 20.40 


n • 140 

M • 20.71 


n - 187^ 

M« I9.S8 


SOUKCE 


df 


Ncaii Squ4ra 


F 


0 


Purpose 


2 


S8.I9 


1.96 


ns 


Error 


883 


29.34 
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T«bU 36 

Analysis of AUIttf4* to Schnol QutttlonMirt: Gr«tc 2 





Sociil «fid 
Interactloftil Skills 


Attitudes to 
School and Leamlni 


N - 413 

M • 20.77 


N • 20.63 


N • 140 
N • 21. M 


SOURCE 


df 


N««n Square 


F 


P 


Purpose 


2 


22.75 


.94 




Error 


64a 


24.23 







Attitude to School Questionnaire. Comparison of student motivation among 
Preschools with differing purposes revealed no significant differences at each 
grade level. In terms of the evaluation hypothesis, this result suggests that 
Preschool Purpose did not Influence students' motivation, as measured by the 
Attitude to School Questionnaire. 



Table 37 

Maljrsis of fercentage of SaMster Absent: Grade if 



^retcadeaic 


Social and 
Interactional Skills 


Attitudes to 
SdNWl and Leamln9 


ft • 746 
H • II. 7a 


N • 156 
H • 8.59 


II • 220 
H • 9.86 


SOURCE 


df 


Hcan Square 


F 


P 


Purpose 


2 


802.'84 


8.46 


p < .01 


tmr 


1121 


94.95 







lli«Mn<Kcv1s Miltlple Coaparlson Test 

Soclel and interactional skills < preacadcnfc p < .01 
Attitudes t« school learning « preacadcalc p < .05 



Tabic 33 

Analysis of Percentage of Scwster Absent: Grade 1 



Preacadaalc 


Social and 
InUractlonal Skills 


Attitudes to 
School and LeamfnQ 


N - 607 
M-8.88 


N • 147 
H - 6.S4 


N - 168 

H • 9.21 


SOURCE . 


df 


Hean Square 


F 


P 


Purpose 


Z 


364.66 


4.95 


p < .01 


Zmr 


919 


73.61 







NoMMn-Kauls Miltlple Coaparlson Test 

Social and Interactional skills < attitude p < ^01 
AttltudH to fchool leiming < preacadaalc p < .05 
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Table 39 

Anitytls of Pcrctnt«9e of Scneste' Absent: Grade 2 





Social and 
tntcractl0fi«l Skills 


Attitudcrto 
School and leamfnQ 


H » 432 

H • 6.91 , 


« • 98 
H • 5.38 


n • 150 
M - 6.31 


SOURCE 


df 


Hc«n Square 


F 


P ' 


Purpose 


2 


99.S0 


2.10 


ns 


Erroi 


677 


47,29 







Attendance , Tests for differences in attendance among Preschools with 
differing purposes were significant at the kindergarten and first-grade levels: 
In kindergarten, Preacademic Skills, It= 11.74, Social and Interaction Skills, 
M = 8.59, and Attitudes to School and Learning, M = 9.86. Multiple-comparison 
Newman-Keuls tests revealed that students in Preschools emphasizing Attitudes to 
School and Learning had significantly better attendance records than Preschools 
emphasizing Preacademic Skills: In the first grade, Preacademic Skills, M = 8.88, 
Social and Interaction Skills, M - 6.54; Attitudes to School and Learning, M = 9.21. 
Multiple-comparison Newman-Keuls tests revealed that students in Preschools 
emphasizing Social and Interaction Skills had significantly better attendance 
records than students in Preschools emphasizing Preacademic Skills or Attitudes 
to School and Learning. In terms of the evaluation hypothesis, this result 
suggests that Preschools concentrating on Attitudes to School and Learning or 
Social and Interaction Skills maintain better attendance levels than Preschools 
emphasizing Preacademic Skills. 

Summary . Preschools emphasizing Social and Interaction Skills graduated 
students who generally had fewer absences in elementary school, while Preschools 
emphasizing Preacademic Skills graduated students who had more absences. 
Differences in Productivity 

For this analysis, the Student Productivity Index (a reversed scale, with a 
lower score "better" than a higher score) was used as the measure of productivity 
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at each grade level. The results: of this analysis are presented in Tables 40 
through 42. 

Student Productivity Index . No significant differences were found among 
Preschool s with differing purposes. In terms of the evaluation hypotheses, 
this result suggests that Preschool Purpose does not influence students' pro- 
ductivity as measured by the Student Productivity Index. 

Summary, Student productivity at the elementary level was not influenced, 
by the purpose of the student's Preschool. 



Table 40 

Analysts of Studtnt Pn>ductt>tty Indei: Gr<4e K 



PrcacAdtntc 


Soc(«1 and 
Interactional Skills 


Attitudes to 
School and Leamfni 
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N « 50.00 
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Mean Square 


F 


0 


Purpose 
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1.02 


ns 


Error 
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rabit 41 

Anal/Sis of Student Prodactlvfty Indei: Grade 1 
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df 
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2 


751.00 


.88 


ns 


Error 
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856.40 




t 



- Table 42 

Analysis of Student Productivity Index: Grade 2 



Preacadenlc 


Social and 
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School and Learnlno 
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Error 
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882.35 







- 92 - 



ERIC 



SUMMARY OF FINDINGS . ' 

Throughout this report of the evaluation study of California's State Pre- 
school Program, a great deal of effort has been made to describe the reasoning 
involved in the formulation of hypotheses, the selection of measures, and in the 
procedures used to find answers to the evaluation questions* CSE firmly believes 
its reasoning resulted in methods that were effective in allowing any discernable 
effects of the Preschool Program to be demonstrated, if such effects existed, and 
thought it worthwhile to detail the logic behind those methods. It can be shown 
that whenever decisions about matters of method or procedure had to be made that 
might sway the evaluation findings in favor of the State Preschool Program or against 
it, a decision to favor the Program was made, (CSE's decisions were based pri- 
marily upon the assumed disadvantage of the Preschool children relative to children 
in the comparison groups. To the extent that the reader disagrees with that assump- ^ 
tion, his/her interpretation of the evaluation findings will be less favorable 
toward the Preschool Program). Therefore, CSE's inclination toward the Program 
must be kept in mind as, by way of summary, each of the three evaluation questions 
from the' first section of the report of this study are repeated* and a summarized 

finding is provided as an answer to each question. 

♦ 

Question One 

Do children who previously experienced the State Preschool Program 
for at least one year show significantly improved performance, motiva" 
tion, and productivity in their subsequent elementary schools when com^ 
pared with children who have either experienced other pre-'school pre 
grams (like the Children's Centers) , or have not experienced a traceable 
institutionalized preschool program? 

Based upon the evaluation comparisons summarized in the first two rows of 
Table 43, CSE offers this evaluation answer: 

Children who attended the State Preschool Program probably show 
improved performance and motivation/ but they probably do not show 
improved productivity. 
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Ttbit 43 

StMMry of Evtluttlon Findings by Prttchool Objtctim 
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SooetlMS Probtbly 
Hort Successful 


Probtbly Hort 

<uCPMftf 111 


Is Any one of tht Stitt 
Preschool Purposts nort 
successful In netting ttch 
objective? 


No Ont Hort 

Successful 


Attitude to School 
tnd LetrrilnQ tnd 
SocUl tnd Intcrac 
tlonal Skills Art 
SoMtlnes Hore 
Successful 


No Ont Hort 
Succtssful 



Question Two 

Were the children' s perforxnance^ motivations and productivity signi" 
ficantly affected by the niunber of enrichment programs, hoth federal 
and state, in their elementary schools? 

Based upon the findings recorded in the last section of this report, CSE 
offers this evaluation answer: 

Dae to sampling based primarily on concerns of the Preschool evalw 
ation, it was not likely that this study obtained a representative 
sample of elementary schools with varying enrichments (and CSE did 
not attempt to obtain such a sample) . The inadequate sampling may 
have caused the frequent finding that enrichment programs had detri" 
mental effects. 

Question Three 

Do children who experienced Preschools with differing purposes show 
significantly improved performance, motivation, and productivity in 
their subsequent elementary schools when compared with children who 
experienced any differing type of Preschool? 

Based upon the evaluation comparisons sumnarized in the Ust row of 

Table 43, CSE offers this evaluation answer; 

According to the categories of Preschool purposes found by CSE, 
no one type of Preschool produced elementary^level children who 
exhibited consistently improved perfdrmance, motivation, or prO" 
ductivity. 
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